Login
Log in using an SSO provider:
Fedora Account System
Red Hat Associate
Red Hat Customer
Login using a Red Hat Bugzilla account
Forgot Password
Create an Account
Red Hat Bugzilla – Attachment 1927368 Details for
Bug 2147526
After performing drive detach and attach, the OSD count does not increase
Home
New
Search
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh92 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
[?]
This site requires JavaScript to be enabled to function correctly, please enable it.
oc logs for rook ceph operator pod
oclogs_rookcephoperator.txt (text/plain), 13.44 MB, created by
Bhavana
on 2022-11-25 06:59:02 UTC
(
hide
)
Description:
oc logs for rook ceph operator pod
Filename:
MIME Type:
Creator:
Bhavana
Created:
2022-11-25 06:59:02 UTC
Size:
13.44 MB
patch
obsolete
>2022-11-23 13:28:55.081622 I | rookcmd: starting Rook v4.11.3-0.224a35508091e5dcf8f09dd910118b75ef52f84e with arguments '/usr/local/bin/rook ceph operator' >2022-11-23 13:28:55.081709 I | rookcmd: flag values: --enable-machine-disruption-budget=false, --help=false, --kubeconfig=, --log-level=INFO, --operator-image=, --service-account= >2022-11-23 13:28:55.081712 I | cephcmd: starting Rook-Ceph operator >2022-11-23 13:28:55.186249 I | cephcmd: base ceph version inside the rook operator image is "ceph version 16.2.8-84.el8cp (c2980f2fd700e979d41b4bad2939bb90f0fe435c) pacific (stable)" >2022-11-23 13:28:55.195992 I | op-k8sutil: ROOK_CURRENT_NAMESPACE_ONLY="true" (env var) >2022-11-23 13:28:55.196004 I | operator: watching the current namespace "openshift-storage" for a Ceph CRs >2022-11-23 13:28:55.196024 I | operator: setting up schemes >2022-11-23 13:28:55.197403 I | operator: setting up the controller-runtime manager >I1123 13:28:56.248125 1 request.go:665] Waited for 1.0482168s due to client-side throttling, not priority and fairness, request: GET:https://172.30.0.1:443/apis/snapshot.storage.k8s.io/v1?timeout=32s >2022-11-23 13:28:58.200948 I | operator: Fetching webhook cert-manager-webhook to see if cert-manager is installed. >2022-11-23 13:28:58.203525 I | operator: failed to get cert manager >2022-11-23 13:28:58.203559 I | ceph-cluster-controller: successfully started >2022-11-23 13:28:58.203607 I | ceph-cluster-controller: hotplug orchestration disabled >2022-11-23 13:28:58.203617 I | ceph-crashcollector-controller: successfully started >2022-11-23 13:28:58.203633 I | ceph-block-pool-controller: successfully started >2022-11-23 13:28:58.203649 I | ceph-object-store-user-controller: successfully started >2022-11-23 13:28:58.203664 I | ceph-object-realm-controller: successfully started >2022-11-23 13:28:58.203676 I | ceph-object-zonegroup-controller: successfully started >2022-11-23 13:28:58.203685 I | ceph-object-zone-controller: successfully started >2022-11-23 13:28:58.203767 I | ceph-object-controller: successfully started >2022-11-23 13:28:58.203788 I | ceph-file-controller: successfully started >2022-11-23 13:28:58.203808 I | ceph-nfs-controller: successfully started >2022-11-23 13:28:58.203825 I | ceph-rbd-mirror-controller: successfully started >2022-11-23 13:28:58.203851 I | ceph-client-controller: successfully started >2022-11-23 13:28:58.203866 I | ceph-filesystem-mirror-controller: successfully started >2022-11-23 13:28:58.203883 I | operator: rook-ceph-operator-config-controller successfully started >2022-11-23 13:28:58.203901 I | ceph-csi: rook-ceph-operator-csi-controller successfully started >2022-11-23 13:28:58.203912 I | op-bucket-prov: rook-ceph-operator-bucket-controller successfully started >2022-11-23 13:28:58.203926 I | ceph-bucket-topic: successfully started >2022-11-23 13:28:58.203934 I | ceph-bucket-notification: successfully started >2022-11-23 13:28:58.203942 I | ceph-bucket-notification: successfully started >2022-11-23 13:28:58.203950 I | ceph-fs-subvolumegroup-controller: successfully started >2022-11-23 13:28:58.203960 I | blockpool-rados-namespace-controller: successfully started >2022-11-23 13:28:58.204994 I | operator: starting the controller-runtime manager >2022-11-23 13:28:58.308823 I | op-k8sutil: ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS="15" (default) >2022-11-23 13:28:58.308841 I | op-k8sutil: ROOK_LOG_LEVEL="INFO" (env var) >2022-11-23 13:28:58.308848 I | op-k8sutil: ROOK_ENABLE_DISCOVERY_DAEMON="false" (env var) >2022-11-23 13:28:58.309238 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openshift-storage" >2022-11-23 13:28:58.311192 I | operator: rook-ceph-operator-config-controller done reconciling >2022-11-23 13:28:58.312304 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:28:58.312363 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:28:58.312379 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:28:58.312401 I | op-k8sutil: ROOK_OBC_WATCH_OPERATOR_NAMESPACE="true" (env var) >2022-11-23 13:28:58.312406 I | op-bucket-prov: ceph bucket provisioner launched watching for provisioner "openshift-storage.ceph.rook.io/bucket" >2022-11-23 13:28:58.312432 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:28:58.312631 I | op-bucket-prov: successfully reconciled bucket provisioner >2022-11-23 13:28:58.312639 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >I1123 13:28:58.312679 1 manager.go:135] objectbucket.io/provisioner-manager "msg"="starting provisioner" "name"="openshift-storage.ceph.rook.io/bucket" >2022-11-23 13:28:58.321237 I | clusterdisruption-controller: deleted all legacy node drain canary pods >2022-11-23 13:28:58.322907 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:28:58.322929 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:28:58.322942 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:28:58.322955 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 13:28:58.322966 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:28:58.322978 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:28:58.322988 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:28:58.393975 I | ceph-block-pool-controller: skipping reconcile since operator is still initializing >2022-11-23 13:28:58.405763 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:28:58.405789 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:28:58.405806 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:28:58.405820 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:28:58.405833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:28:58.405848 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 13:28:58.405863 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:28:58.511707 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:28:58.511741 I | ceph-spec: detecting the ceph image version for image registry.redhat.io/rhceph/rhceph-5-rhel8@sha256:7892e9da0a70b2d7e3efd98d2cb980e485f07eddff6a0dac6d6bd6c516914f3c... >2022-11-23 13:28:58.712490 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:28:58.712516 I | ceph-spec: detecting the ceph image version for image registry.redhat.io/rhceph/rhceph-5-rhel8@sha256:7892e9da0a70b2d7e3efd98d2cb980e485f07eddff6a0dac6d6bd6c516914f3c... >2022-11-23 13:28:58.911816 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:28:58.923577 I | ceph-cluster-controller: enabling ceph mon monitoring goroutine for cluster "openshift-storage" >2022-11-23 13:28:58.923597 I | ceph-cluster-controller: enabling ceph osd monitoring goroutine for cluster "openshift-storage" >2022-11-23 13:28:58.923604 I | ceph-cluster-controller: ceph status check interval is 1m0s >2022-11-23 13:28:58.923608 I | ceph-cluster-controller: enabling ceph status monitoring goroutine for cluster "openshift-storage" >2022-11-23 13:28:59.001689 I | ceph-cluster-controller: skipping ceph status since operator is still initializing >2022-11-23 13:28:59.115316 I | ceph-csi: successfully created csi config map "rook-ceph-csi-config" >2022-11-23 13:28:59.970299 I | ceph-spec: detecting the ceph image version for image registry.redhat.io/rhceph/rhceph-5-rhel8@sha256:7892e9da0a70b2d7e3efd98d2cb980e485f07eddff6a0dac6d6bd6c516914f3c... >2022-11-23 13:29:00.111380 I | op-k8sutil: ROOK_CSI_ENABLE_RBD="true" (default) >2022-11-23 13:29:00.111398 I | op-k8sutil: ROOK_CSI_ENABLE_CEPHFS="true" (default) >2022-11-23 13:29:00.111401 I | op-k8sutil: ROOK_CSI_ENABLE_NFS="false" (default) >2022-11-23 13:29:00.111404 I | op-k8sutil: ROOK_CSI_ALLOW_UNSUPPORTED_VERSION="true" (env var) >2022-11-23 13:29:00.111406 I | op-k8sutil: ROOK_CSI_ENABLE_GRPC_METRICS="false" (default) >2022-11-23 13:29:00.111410 I | op-k8sutil: CSI_ENABLE_HOST_NETWORK="true" (default) >2022-11-23 13:29:00.111412 I | op-k8sutil: CSI_FORCE_CEPHFS_KERNEL_CLIENT="true" (default) >2022-11-23 13:29:00.111415 I | op-k8sutil: CSI_GRPC_TIMEOUT_SECONDS="150" (default) >2022-11-23 13:29:00.111418 I | op-k8sutil: CSI_CEPHFS_GRPC_METRICS_PORT="9091" (default) >2022-11-23 13:29:00.111420 I | op-k8sutil: CSI_CEPHFS_GRPC_METRICS_PORT="9091" (default) >2022-11-23 13:29:00.111422 I | op-k8sutil: CSI_CEPHFS_LIVENESS_METRICS_PORT="9081" (default) >2022-11-23 13:29:00.111424 I | op-k8sutil: CSI_CEPHFS_LIVENESS_METRICS_PORT="9081" (default) >2022-11-23 13:29:00.111427 I | op-k8sutil: CSI_RBD_GRPC_METRICS_PORT="9090" (default) >2022-11-23 13:29:00.111429 I | op-k8sutil: CSI_RBD_GRPC_METRICS_PORT="9090" (default) >2022-11-23 13:29:00.111455 I | op-k8sutil: CSIADDONS_PORT="9070" (default) >2022-11-23 13:29:00.111458 I | op-k8sutil: CSIADDONS_PORT="9070" (default) >2022-11-23 13:29:00.111460 I | op-k8sutil: CSI_RBD_LIVENESS_METRICS_PORT="9080" (default) >2022-11-23 13:29:00.111462 I | op-k8sutil: CSI_RBD_LIVENESS_METRICS_PORT="9080" (default) >2022-11-23 13:29:00.111465 I | op-k8sutil: CSI_PLUGIN_PRIORITY_CLASSNAME="" (default) >2022-11-23 13:29:00.111467 I | op-k8sutil: CSI_PROVISIONER_PRIORITY_CLASSNAME="" (default) >2022-11-23 13:29:00.111470 I | op-k8sutil: CSI_ENABLE_OMAP_GENERATOR="false" (default) >2022-11-23 13:29:00.111472 I | op-k8sutil: CSI_ENABLE_RBD_SNAPSHOTTER="true" (default) >2022-11-23 13:29:00.111474 I | op-k8sutil: CSI_ENABLE_CEPHFS_SNAPSHOTTER="true" (default) >2022-11-23 13:29:00.111476 I | op-k8sutil: CSI_ENABLE_VOLUME_REPLICATION="false" (default) >2022-11-23 13:29:00.111478 I | op-k8sutil: CSI_ENABLE_CSIADDONS="true" (configmap) >2022-11-23 13:29:00.111481 I | op-k8sutil: CSI_ENABLE_ENCRYPTION="false" (default) >2022-11-23 13:29:00.111483 I | op-k8sutil: CSI_CEPHFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) >2022-11-23 13:29:00.111497 I | op-k8sutil: CSI_NFS_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) >2022-11-23 13:29:00.111499 I | op-k8sutil: CSI_RBD_PLUGIN_UPDATE_STRATEGY="RollingUpdate" (default) >2022-11-23 13:29:00.111501 I | op-k8sutil: CSI_PLUGIN_ENABLE_SELINUX_HOST_MOUNT="false" (default) >2022-11-23 13:29:00.111504 I | ceph-csi: Kubernetes version is 1.24 >2022-11-23 13:29:00.111509 I | op-k8sutil: ROOK_CSI_RESIZER_IMAGE="registry.redhat.io/openshift4/ose-csi-external-resizer@sha256:2d9c535b8d8f18e1c4e6bbcb2b18683db42f56dad853e1ac7fa4e092a95b08b8" (env var) >2022-11-23 13:29:00.111511 I | op-k8sutil: CSI_LOG_LEVEL="5" (configmap) >2022-11-23 13:29:00.312027 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:29:00.312097 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:00.312212 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:01.114277 I | op-k8sutil: CSI_PROVISIONER_REPLICAS="2" (default) >2022-11-23 13:29:01.114293 I | op-k8sutil: ROOK_CSI_CEPH_IMAGE="registry.redhat.io/odf4/cephcsi-rhel8@sha256:4295dc01c77441833ab380c1fe5069a38f239e1de732bcc23216ec8267ec5950" (env var) >2022-11-23 13:29:01.114298 I | op-k8sutil: ROOK_CSI_NFS_IMAGE="registry.redhat.io/openshift4/ose-csi-driver-nfs-rhel8@sha256:3a0b8dae6d801e55a8fbfcd9099c01df441c629b160ea2e10d96c78ab5edc7ce" (env var) >2022-11-23 13:29:01.114301 I | op-k8sutil: ROOK_CSI_REGISTRAR_IMAGE="registry.redhat.io/openshift4/ose-csi-node-driver-registrar@sha256:8d4878150d861c7343c2e9fce5f23ed8fc4ba871f8d5ca66321a72a8011d052c" (env var) >2022-11-23 13:29:01.114305 I | op-k8sutil: ROOK_CSI_PROVISIONER_IMAGE="registry.redhat.io/openshift4/ose-csi-external-provisioner@sha256:f7c70fdbfeea3b3d890a7b30971a4a0f4164793228283e859d2479af7ce4b385" (env var) >2022-11-23 13:29:01.114308 I | op-k8sutil: ROOK_CSI_ATTACHER_IMAGE="registry.redhat.io/openshift4/ose-csi-external-attacher-rhel8@sha256:8ddc467b1d6d967c8f59f5eb89152694c06b51b1302975f904483ab9ea355c9a" (env var) >2022-11-23 13:29:01.114311 I | op-k8sutil: ROOK_CSI_SNAPSHOTTER_IMAGE="registry.redhat.io/openshift4/ose-csi-external-snapshotter-rhel8@sha256:12ea1e66431e39621e3b74f71f82ea2dcac3634f781afd72648061009e931b79" (env var) >2022-11-23 13:29:01.114314 I | op-k8sutil: ROOK_CSI_KUBELET_DIR_PATH="/var/lib/kubelet" (default) >2022-11-23 13:29:01.114318 I | op-k8sutil: CSI_VOLUME_REPLICATION_IMAGE="registry.redhat.io/odf4/volume-replication-rhel8-operator@sha256:e24ed0766bd0c448ea496020399bad52e07f9981184bb141c07cb6d35212dd62" (env var) >2022-11-23 13:29:01.114321 I | op-k8sutil: ROOK_CSIADDONS_IMAGE="registry.redhat.io/odf4/odf-csi-addons-sidecar-rhel8@sha256:4f05b3f18e4ebd505f233e15ef027f3dabcbd5c1e6d15a30326bff7c546fdb7f" (env var) >2022-11-23 13:29:01.114323 I | op-k8sutil: ROOK_CSI_CEPHFS_POD_LABELS="" (default) >2022-11-23 13:29:01.114325 I | op-k8sutil: ROOK_CSI_NFS_POD_LABELS="" (default) >2022-11-23 13:29:01.114327 I | op-k8sutil: ROOK_CSI_RBD_POD_LABELS="" (default) >2022-11-23 13:29:01.114329 I | ceph-csi: skipping csi version check, since unsupported versions are allowed or csi is disabled >2022-11-23 13:29:01.118880 I | op-k8sutil: CSI_PROVISIONER_TOLERATIONS="\n- key: node.ocs.openshift.io/storage\n operator: Equal\n value: \"true\"\n effect: NoSchedule" (configmap) >2022-11-23 13:29:01.118919 I | op-k8sutil: CSI_PROVISIONER_NODE_AFFINITY="" (default) >2022-11-23 13:29:01.118924 I | op-k8sutil: CSI_PLUGIN_TOLERATIONS="\n- key: node.ocs.openshift.io/storage\n operator: Equal\n value: \"true\"\n effect: NoSchedule" (configmap) >2022-11-23 13:29:01.118946 I | op-k8sutil: CSI_PLUGIN_NODE_AFFINITY="" (default) >2022-11-23 13:29:01.118949 I | op-k8sutil: CSI_RBD_PLUGIN_TOLERATIONS="" (default) >2022-11-23 13:29:01.118951 I | op-k8sutil: CSI_RBD_PLUGIN_NODE_AFFINITY="" (default) >2022-11-23 13:29:01.118961 I | op-k8sutil: CSI_RBD_PLUGIN_RESOURCE="" (default) >2022-11-23 13:29:01.138551 I | op-k8sutil: CSI_RBD_PROVISIONER_TOLERATIONS="" (default) >2022-11-23 13:29:01.138560 I | op-k8sutil: CSI_RBD_PROVISIONER_NODE_AFFINITY="" (default) >2022-11-23 13:29:01.138563 I | op-k8sutil: CSI_RBD_PROVISIONER_RESOURCE="" (default) >2022-11-23 13:29:01.158501 I | ceph-csi: successfully started CSI Ceph RBD driver >2022-11-23 13:29:01.912907 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:29:01.912975 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:01.913084 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:02.312281 I | op-k8sutil: CSI_CEPHFS_PLUGIN_TOLERATIONS="" (default) >2022-11-23 13:29:02.312297 I | op-k8sutil: CSI_CEPHFS_PLUGIN_NODE_AFFINITY="" (default) >2022-11-23 13:29:02.312301 I | op-k8sutil: CSI_CEPHFS_PLUGIN_RESOURCE="" (default) >2022-11-23 13:29:02.329268 I | op-k8sutil: CSI_CEPHFS_PROVISIONER_TOLERATIONS="" (default) >2022-11-23 13:29:02.329278 I | op-k8sutil: CSI_CEPHFS_PROVISIONER_NODE_AFFINITY="" (default) >2022-11-23 13:29:02.329281 I | op-k8sutil: CSI_CEPHFS_PROVISIONER_RESOURCE="" (default) >2022-11-23 13:29:02.349522 I | ceph-csi: successfully started CSI CephFS driver >2022-11-23 13:29:02.912991 I | op-k8sutil: CSI_RBD_FSGROUPPOLICY="ReadWriteOnceWithFSType" (default) >2022-11-23 13:29:02.918057 I | ceph-csi: CSIDriver object updated for driver "openshift-storage.rbd.csi.ceph.com" >2022-11-23 13:29:02.918092 I | op-k8sutil: CSI_CEPHFS_FSGROUPPOLICY="ReadWriteOnceWithFSType" (default) >2022-11-23 13:29:02.922524 I | ceph-csi: CSIDriver object updated for driver "openshift-storage.cephfs.csi.ceph.com" >2022-11-23 13:29:02.922538 I | ceph-csi: CSI NFS driver disabled >2022-11-23 13:29:02.922543 I | op-k8sutil: removing daemonset csi-nfsplugin if it exists >2022-11-23 13:29:02.925124 I | op-k8sutil: removing deployment csi-nfsplugin-provisioner if it exists >2022-11-23 13:29:03.113166 I | ceph-csi: successfully removed CSI NFS driver >2022-11-23 13:29:08.383260 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:29:08.383314 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:08.383423 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:08.399559 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:29:08.405832 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 13:29:08.405860 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:29:08.405874 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:29:08.405887 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:29:08.405900 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:29:08.405914 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:29:08.405925 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:29:08.479804 I | ceph-block-pool-controller: skipping reconcile since operator is still initializing >2022-11-23 13:29:08.486469 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:29:08.486493 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 13:29:08.486509 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:29:08.486521 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:29:08.486537 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:29:08.486549 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:29:08.486563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:29:10.337789 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:29:10.337842 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:10.337952 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:11.937690 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:29:11.937757 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:11.937872 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:14.790813 I | ceph-spec: detected ceph image version: "16.2.8-84 pacific" >2022-11-23 13:29:14.790865 I | ceph-spec: detected ceph image version: "16.2.8-84 pacific" >2022-11-23 13:29:14.802885 I | ceph-spec: detected ceph image version: "16.2.8-84 pacific" >2022-11-23 13:29:14.802895 I | ceph-cluster-controller: validating ceph version from provided image >2022-11-23 13:29:14.805818 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:29:14.807733 I | cephclient: writing config file /var/lib/rook/openshift-storage/openshift-storage.config >2022-11-23 13:29:14.807830 I | cephclient: generated admin config in /var/lib/rook/openshift-storage >2022-11-23 13:29:15.133375 I | ceph-cluster-controller: cluster "openshift-storage": version "16.2.8-84 pacific" detected for image "registry.redhat.io/rhceph/rhceph-5-rhel8@sha256:7892e9da0a70b2d7e3efd98d2cb980e485f07eddff6a0dac6d6bd6c516914f3c" >2022-11-23 13:29:15.197827 I | op-mon: start running mons >2022-11-23 13:29:15.201809 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:29:15.639460 I | ceph-file-controller: start running mdses for filesystem "ocs-storagecluster-cephfilesystem" >2022-11-23 13:29:15.650749 I | ceph-object-controller: reconciling object store deployments >2022-11-23 13:29:15.938079 I | cephclient: getting or creating ceph auth key "mds.ocs-storagecluster-cephfilesystem-a" >2022-11-23 13:29:16.585581 I | op-mon: saved mon endpoints to config map map[csi-cluster-config-json:[{"clusterID":"openshift-storage","monitors":["172.30.219.163:6789","172.30.188.21:6789","172.30.33.66:6789"],"namespace":""}] data:a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 mapping:{"node":{"a":null,"b":null,"c":null}} maxMonId:2] >2022-11-23 13:29:16.984984 I | ceph-object-controller: ceph object store gateway service running at 172.30.255.174 >2022-11-23 13:29:16.985004 I | ceph-object-controller: reconciling object store pools >2022-11-23 13:29:17.230272 W | ceph-object-controller: failed to adjust the PG count for rgw metadata pools. using the general default. failed to get config setting "rgw_rados_pool_pg_num_min" for user "mon.": exit status 2 >2022-11-23 13:29:17.784533 I | op-mds: setting mds config flags >2022-11-23 13:29:17.784559 I | op-config: setting "mds.ocs-storagecluster-cephfilesystem-a"="mds_cache_memory_limit"="4294967296" option to the mon configuration database >2022-11-23 13:29:17.983480 I | cephclient: writing config file /var/lib/rook/openshift-storage/openshift-storage.config >2022-11-23 13:29:17.983806 I | cephclient: generated admin config in /var/lib/rook/openshift-storage >2022-11-23 13:29:18.042093 I | cephclient: application "rook-ceph-rgw" is already set on pool "ocs-storagecluster-cephobjectstore.rgw.log" >2022-11-23 13:29:18.042108 I | cephclient: reconciling replicated pool ocs-storagecluster-cephobjectstore.rgw.log succeeded >2022-11-23 13:29:18.045740 I | cephclient: application "rook-ceph-rgw" is already set on pool "ocs-storagecluster-cephobjectstore.rgw.meta" >2022-11-23 13:29:18.045760 I | cephclient: reconciling replicated pool ocs-storagecluster-cephobjectstore.rgw.meta succeeded >2022-11-23 13:29:18.062259 I | op-config: successfully set "mds.ocs-storagecluster-cephfilesystem-a"="mds_cache_memory_limit"="4294967296" option to the mon configuration database >2022-11-23 13:29:18.062280 I | op-config: setting "mds.ocs-storagecluster-cephfilesystem-a"="mds_join_fs"="ocs-storagecluster-cephfilesystem" option to the mon configuration database >2022-11-23 13:29:18.068729 I | cephclient: application "rook-ceph-rgw" is already set on pool "ocs-storagecluster-cephobjectstore.rgw.buckets.non-ec" >2022-11-23 13:29:18.068745 I | cephclient: reconciling replicated pool ocs-storagecluster-cephobjectstore.rgw.buckets.non-ec succeeded >2022-11-23 13:29:18.076498 I | cephclient: application "rook-ceph-rgw" is already set on pool ".rgw.root" >2022-11-23 13:29:18.076517 I | cephclient: reconciling replicated pool .rgw.root succeeded >2022-11-23 13:29:18.080361 I | cephclient: application "rook-ceph-rgw" is already set on pool "ocs-storagecluster-cephobjectstore.rgw.control" >2022-11-23 13:29:18.080374 I | cephclient: reconciling replicated pool ocs-storagecluster-cephobjectstore.rgw.control succeeded >2022-11-23 13:29:18.086643 I | cephclient: application "rook-ceph-rgw" is already set on pool "ocs-storagecluster-cephobjectstore.rgw.buckets.index" >2022-11-23 13:29:18.086659 I | cephclient: reconciling replicated pool ocs-storagecluster-cephobjectstore.rgw.buckets.index succeeded >2022-11-23 13:29:18.348624 I | op-config: successfully set "mds.ocs-storagecluster-cephfilesystem-a"="mds_join_fs"="ocs-storagecluster-cephfilesystem" option to the mon configuration database >2022-11-23 13:29:18.356937 I | op-mds: deployment for mds "rook-ceph-mds-ocs-storagecluster-cephfilesystem-a" already exists. updating if needed >2022-11-23 13:29:18.365897 I | op-k8sutil: deployment "rook-ceph-mds-ocs-storagecluster-cephfilesystem-a" did not change, nothing to update >2022-11-23 13:29:18.365918 I | cephclient: getting or creating ceph auth key "mds.ocs-storagecluster-cephfilesystem-b" >2022-11-23 13:29:18.487492 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:29:18.487529 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:29:18.487546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:29:18.487563 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:29:18.487578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 13:29:18.487596 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:29:18.487611 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:29:18.821201 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:29:19.090679 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:29:19.090711 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 13:29:19.090730 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:29:19.090745 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:29:19.090759 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:29:19.090771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:29:19.090782 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:29:19.191938 I | cephclient: setting pool property "target_size_ratio" to "0.49" on pool "ocs-storagecluster-cephobjectstore.rgw.buckets.data" >2022-11-23 13:29:19.418680 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:29:19.584050 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:29:19.584117 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:19.584231 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:19.785112 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:29:19.818418 I | ceph-object-store-user-controller: creating ceph object user "noobaa-ceph-objectstore-user" in namespace "openshift-storage" >2022-11-23 13:29:19.871326 I | ceph-object-store-user-controller: retrieved existing ceph object user "noobaa-ceph-objectstore-user" >2022-11-23 13:29:19.878562 I | ceph-spec: updated ceph "*v1.Secret" object "rook-ceph-object-user-ocs-storagecluster-cephobjectstore-noobaa-ceph-objectstore-user" >2022-11-23 13:29:20.055962 I | ceph-block-pool-controller: creating pool "ocs-storagecluster-cephblockpool" in namespace "openshift-storage" >2022-11-23 13:29:20.576348 I | cephclient: setting pool property "target_size_ratio" to "0.49" on pool "ocs-storagecluster-cephblockpool" >2022-11-23 13:29:20.585806 I | op-mds: setting mds config flags >2022-11-23 13:29:20.585831 I | op-config: setting "mds.ocs-storagecluster-cephfilesystem-b"="mds_join_fs"="ocs-storagecluster-cephfilesystem" option to the mon configuration database >2022-11-23 13:29:20.659809 I | cephclient: application "rook-ceph-rgw" is already set on pool "ocs-storagecluster-cephobjectstore.rgw.buckets.data" >2022-11-23 13:29:20.659828 I | cephclient: reconciling replicated pool ocs-storagecluster-cephobjectstore.rgw.buckets.data succeeded >2022-11-23 13:29:20.850671 I | op-config: successfully set "mds.ocs-storagecluster-cephfilesystem-b"="mds_join_fs"="ocs-storagecluster-cephfilesystem" option to the mon configuration database >2022-11-23 13:29:20.850693 I | op-config: setting "mds.ocs-storagecluster-cephfilesystem-b"="mds_cache_memory_limit"="4294967296" option to the mon configuration database >2022-11-23 13:29:21.112933 I | op-config: successfully set "mds.ocs-storagecluster-cephfilesystem-b"="mds_cache_memory_limit"="4294967296" option to the mon configuration database >2022-11-23 13:29:21.122327 I | op-mds: deployment for mds "rook-ceph-mds-ocs-storagecluster-cephfilesystem-b" already exists. updating if needed >2022-11-23 13:29:21.131619 I | op-k8sutil: deployment "rook-ceph-mds-ocs-storagecluster-cephfilesystem-b" did not change, nothing to update >2022-11-23 13:29:21.185025 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:29:21.185112 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:21.185327 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:21.194341 I | ceph-object-controller: setting multisite settings for object store "ocs-storagecluster-cephobjectstore" >2022-11-23 13:29:21.379858 I | ceph-object-store-user-controller: creating ceph object user "ocs-storagecluster-cephobjectstoreuser" in namespace "openshift-storage" >2022-11-23 13:29:21.384918 I | op-mon: targeting the mon count 3 >2022-11-23 13:29:21.395876 I | op-config: setting "global"="mon allow pool delete"="true" option to the mon configuration database >2022-11-23 13:29:21.416188 I | ceph-object-controller: there are no changes to commit for RGW configuration period for CephObjectStore "openshift-storage/ocs-storagecluster-cephobjectstore" >2022-11-23 13:29:21.416207 I | ceph-object-controller: Multisite for object-store: realm=ocs-storagecluster-cephobjectstore, zonegroup=ocs-storagecluster-cephobjectstore, zone=ocs-storagecluster-cephobjectstore >2022-11-23 13:29:21.416211 I | ceph-object-controller: multisite configuration for object-store ocs-storagecluster-cephobjectstore is complete >2022-11-23 13:29:21.416216 I | ceph-object-controller: creating object store "ocs-storagecluster-cephobjectstore" in namespace "openshift-storage" >2022-11-23 13:29:21.416223 I | cephclient: getting or creating ceph auth key "client.rgw.ocs.storagecluster.cephobjectstore.a" >2022-11-23 13:29:21.432988 I | ceph-object-store-user-controller: retrieved existing ceph object user "ocs-storagecluster-cephobjectstoreuser" >2022-11-23 13:29:21.441600 I | ceph-spec: updated ceph "*v1.Secret" object "rook-ceph-object-user-ocs-storagecluster-cephobjectstore-ocs-storagecluster-cephobjectstoreuser" >2022-11-23 13:29:21.460888 I | ceph-file-controller: filesystem "ocs-storagecluster-cephfilesystem" already exists >2022-11-23 13:29:21.660783 I | op-config: successfully set "global"="mon allow pool delete"="true" option to the mon configuration database >2022-11-23 13:29:21.660808 I | op-config: setting "global"="mon cluster log file"="" option to the mon configuration database >2022-11-23 13:29:21.780671 I | cephclient: application "rbd" is already set on pool "ocs-storagecluster-cephblockpool" >2022-11-23 13:29:21.780688 I | cephclient: reconciling replicated pool ocs-storagecluster-cephblockpool succeeded >2022-11-23 13:29:21.785594 I | ceph-object-controller: setting rgw config flags >2022-11-23 13:29:21.785615 I | op-config: setting "client.rgw.ocs.storagecluster.cephobjectstore.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database >2022-11-23 13:29:21.929706 I | op-config: successfully set "global"="mon cluster log file"="" option to the mon configuration database >2022-11-23 13:29:21.929736 I | op-config: setting "global"="mon allow pool size one"="true" option to the mon configuration database >2022-11-23 13:29:22.047900 I | op-config: successfully set "client.rgw.ocs.storagecluster.cephobjectstore.a"="rgw_log_nonexistent_bucket"="true" option to the mon configuration database >2022-11-23 13:29:22.047923 I | op-config: setting "client.rgw.ocs.storagecluster.cephobjectstore.a"="rgw_log_object_name_utc"="true" option to the mon configuration database >2022-11-23 13:29:22.184155 I | ceph-spec: parsing mon endpoints: a=172.30.219.163:6789,b=172.30.188.21:6789,c=172.30.33.66:6789 >2022-11-23 13:29:22.184227 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:22.184375 I | ceph-object-store-user-controller: CephObjectStore "ocs-storagecluster-cephobjectstore" found >2022-11-23 13:29:22.208184 I | op-config: successfully set "global"="mon allow pool size one"="true" option to the mon configuration database >2022-11-23 13:29:22.208204 I | op-config: setting "global"="osd scrub auto repair"="true" option to the mon configuration database >2022-11-23 13:29:22.336507 I | op-config: successfully set "client.rgw.ocs.storagecluster.cephobjectstore.a"="rgw_log_object_name_utc"="true" option to the mon configuration database >2022-11-23 13:29:22.336532 I | op-config: setting "client.rgw.ocs.storagecluster.cephobjectstore.a"="rgw_enable_usage_log"="true" option to the mon configuration database >2022-11-23 13:29:22.345737 I | ceph-block-pool-controller: initializing pool "ocs-storagecluster-cephblockpool" >2022-11-23 13:29:22.381300 I | ceph-object-store-user-controller: creating ceph object user "prometheus-user" in namespace "openshift-storage" >2022-11-23 13:29:22.476929 I | ceph-object-store-user-controller: updated ceph object user "prometheus-user" >2022-11-23 13:29:22.484072 I | ceph-spec: updated ceph "*v1.Secret" object "rook-ceph-object-user-ocs-storagecluster-cephobjectstore-prometheus-user" >2022-11-23 13:29:22.489256 I | op-config: successfully set "global"="osd scrub auto repair"="true" option to the mon configuration database >2022-11-23 13:29:22.489270 I | op-config: setting "global"="log to file"="true" option to the mon configuration database >2022-11-23 13:29:22.515169 I | ceph-block-pool-controller: successfully initialized pool "ocs-storagecluster-cephblockpool" >2022-11-23 13:29:22.515215 I | op-config: setting "mgr."="mgr/prometheus/rbd_stats_pools"="ocs-storagecluster-cephblockpool" option to the mon configuration database >2022-11-23 13:29:22.609627 I | op-config: successfully set "client.rgw.ocs.storagecluster.cephobjectstore.a"="rgw_enable_usage_log"="true" option to the mon configuration database >2022-11-23 13:29:22.609660 I | op-config: setting "client.rgw.ocs.storagecluster.cephobjectstore.a"="rgw_zone"="ocs-storagecluster-cephobjectstore" option to the mon configuration database >2022-11-23 13:29:22.750109 I | op-config: successfully set "global"="log to file"="true" option to the mon configuration database >2022-11-23 13:29:22.750130 I | op-config: deleting "log file" option from the mon configuration database >2022-11-23 13:29:22.777044 I | op-config: successfully set "mgr."="mgr/prometheus/rbd_stats_pools"="ocs-storagecluster-cephblockpool" option to the mon configuration database >2022-11-23 13:29:22.875479 I | op-config: successfully set "client.rgw.ocs.storagecluster.cephobjectstore.a"="rgw_zone"="ocs-storagecluster-cephobjectstore" option to the mon configuration database >2022-11-23 13:29:22.875502 I | op-config: setting "client.rgw.ocs.storagecluster.cephobjectstore.a"="rgw_zonegroup"="ocs-storagecluster-cephobjectstore" option to the mon configuration database >2022-11-23 13:29:23.008798 I | op-config: successfully deleted "log file" option from the mon configuration database >2022-11-23 13:29:23.008818 I | op-mon: checking for basic quorum with existing mons >2022-11-23 13:29:23.029707 I | op-mon: mon "b" ip is 172.30.188.21 >2022-11-23 13:29:23.050044 I | cephclient: reconciling replicated pool ocs-storagecluster-cephfilesystem-metadata succeeded >2022-11-23 13:29:23.141678 I | op-config: successfully set "client.rgw.ocs.storagecluster.cephobjectstore.a"="rgw_zonegroup"="ocs-storagecluster-cephobjectstore" option to the mon configuration database >2022-11-23 13:29:23.141969 I | ceph-object-controller: object store "ocs-storagecluster-cephobjectstore" deployment "rook-ceph-rgw-ocs-storagecluster-cephobjectstore-a" created >2022-11-23 13:29:23.150253 I | ceph-object-controller: object store "ocs-storagecluster-cephobjectstore" deployment "rook-ceph-rgw-ocs-storagecluster-cephobjectstore-a" already exists. updating if needed >2022-11-23 13:29:23.156715 I | op-k8sutil: deployment "rook-ceph-rgw-ocs-storagecluster-cephobjectstore-a" did not change, nothing to update >2022-11-23 13:29:23.383710 I | ceph-object-controller: config map "rook-ceph-rgw-ocs-storagecluster-cephobjectstore-mime-types" for object store "ocs-storagecluster-cephobjectstore" already exists, not overwriting >2022-11-23 13:29:23.394826 I | ceph-object-controller: enabling rgw dashboard >2022-11-23 13:29:23.655892 W | ceph-object-controller: failed to enable dashboard for rgw. failed to retrieve RGW Dashboard credentials for "dashboard-admin" user: exit status 95 >2022-11-23 13:29:23.655911 I | ceph-object-controller: created object store "ocs-storagecluster-cephobjectstore" in namespace "openshift-storage" >2022-11-23 13:29:23.848283 I | ceph-object-controller: starting rgw health checker for CephObjectStore "openshift-storage/ocs-storagecluster-cephobjectstore" >2022-11-23 13:29:23.859840 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:29:23.859867 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:29:23.859884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:29:23.859906 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 13:29:23.859922 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:29:23.859941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:29:23.859955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:29:23.986303 I | op-mon: mon "c" ip is 172.30.33.66 >2022-11-23 13:29:24.133704 I | cephclient: setting pool property "target_size_ratio" to "0.49" on pool "ocs-storagecluster-cephfilesystem-data0" >2022-11-23 13:29:24.171733 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:29:24.441505 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:29:24.441534 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 13:29:24.441564 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:29:24.441580 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:29:24.441593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:29:24.441606 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:29:24.441618 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:29:24.750188 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 13:29:24.788217 I | op-mon: mon "a" ip is 172.30.219.163 >2022-11-23 13:29:25.385510 I | op-mon: saved mon endpoints to config map map[csi-cluster-config-json:[{"clusterID":"openshift-storage","monitors":["172.30.219.163:6789","172.30.188.21:6789","172.30.33.66:6789"],"namespace":""}] data:b=172.30.188.21:6789,c=172.30.33.66:6789,a=172.30.219.163:6789 mapping:{"node":{"a":null,"b":null,"c":null}} maxMonId:2] >2022-11-23 13:29:25.391348 I | cephclient: reconciling replicated pool ocs-storagecluster-cephfilesystem-data0 succeeded >2022-11-23 13:29:25.985061 I | cephclient: writing config file /var/lib/rook/openshift-storage/openshift-storage.config >2022-11-23 13:29:25.985190 I | cephclient: generated admin config in /var/lib/rook/openshift-storage >2022-11-23 13:29:26.184780 I | cephclient: setting allow_standby_replay for filesystem "ocs-storagecluster-cephfilesystem" >2022-11-23 13:29:26.584036 I | op-mon: deployment for mon rook-ceph-mon-b already exists. updating if needed >2022-11-23 13:29:26.589971 I | op-k8sutil: deployment "rook-ceph-mon-b" did not change, nothing to update >2022-11-23 13:29:26.589987 I | op-mon: waiting for mon quorum with [b c a] >2022-11-23 13:29:27.194541 I | op-mon: mons running: [b c a] >2022-11-23 13:29:27.494179 I | op-mon: Monitors in quorum: [a b c] >2022-11-23 13:29:27.501523 I | op-mon: deployment for mon rook-ceph-mon-c already exists. updating if needed >2022-11-23 13:29:27.508008 I | op-k8sutil: deployment "rook-ceph-mon-c" did not change, nothing to update >2022-11-23 13:29:27.508020 I | op-mon: waiting for mon quorum with [b c a] >2022-11-23 13:29:28.000582 I | op-mon: mons running: [b c a] >2022-11-23 13:29:28.313685 I | op-mon: Monitors in quorum: [a b c] >2022-11-23 13:29:28.321069 I | op-mon: deployment for mon rook-ceph-mon-a already exists. updating if needed >2022-11-23 13:29:28.327743 I | op-k8sutil: deployment "rook-ceph-mon-a" did not change, nothing to update >2022-11-23 13:29:28.327766 I | op-mon: waiting for mon quorum with [b c a] >2022-11-23 13:29:28.792736 I | op-mon: mons running: [b c a] >2022-11-23 13:29:29.098905 I | op-mon: Monitors in quorum: [a b c] >2022-11-23 13:29:29.098924 I | op-mon: mons created: 3 >2022-11-23 13:29:29.402555 I | op-mon: waiting for mon quorum with [b c a] >2022-11-23 13:29:29.438561 I | op-mon: mons running: [b c a] >2022-11-23 13:29:29.739420 I | op-mon: Monitors in quorum: [a b c] >2022-11-23 13:29:29.740755 I | op-mon: checking for orphaned mon resources >2022-11-23 13:29:30.101593 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner" >2022-11-23 13:29:30.421906 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node" >2022-11-23 13:29:30.734851 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner" >2022-11-23 13:29:31.044650 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node" >2022-11-23 13:29:31.379372 I | ceph-csi: created kubernetes csi secrets for cluster "openshift-storage" >2022-11-23 13:29:31.379390 I | cephclient: getting or creating ceph auth key "client.crash" >2022-11-23 13:29:31.699659 I | ceph-crashcollector-controller: created kubernetes crash collector secret for cluster "openshift-storage" >2022-11-23 13:29:31.699681 I | op-config: deleting "mon_mds_skip_sanity" option from the mon configuration database >2022-11-23 13:29:31.960962 I | op-config: successfully deleted "mon_mds_skip_sanity" option from the mon configuration database >2022-11-23 13:29:31.960991 I | cephclient: create rbd-mirror bootstrap peer token "client.rbd-mirror-peer" >2022-11-23 13:29:31.960995 I | cephclient: getting or creating ceph auth key "client.rbd-mirror-peer" >2022-11-23 13:29:32.286999 I | cephclient: successfully created rbd-mirror bootstrap peer token for cluster "ocs-storagecluster-cephcluster" >2022-11-23 13:29:32.310958 I | op-mgr: start running mgr >2022-11-23 13:29:32.310975 I | cephclient: getting or creating ceph auth key "mgr.a" >2022-11-23 13:29:32.637006 I | op-mgr: deployment for mgr rook-ceph-mgr-a already exists. updating if needed >2022-11-23 13:29:32.645763 I | op-k8sutil: deployment "rook-ceph-mgr-a" did not change, nothing to update >2022-11-23 13:29:32.649035 I | op-mgr: setting services to point to mgr "a" >W1123 13:29:33.386772 1 client_config.go:617] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work. >2022-11-23 13:29:33.583624 I | op-mgr: no need to update service "rook-ceph-mgr" >2022-11-23 13:29:33.583817 I | op-mgr: successful modules: balancer >2022-11-23 13:29:33.597917 I | op-osd: start running osds in namespace "openshift-storage" >2022-11-23 13:29:33.597929 I | op-osd: wait timeout for healthy OSDs during upgrade or restart is "10m0s" >2022-11-23 13:29:33.650922 I | op-osd: start provisioning the OSDs on PVCs, if needed >2022-11-23 13:29:33.791082 I | op-osd: verifying PVCs exist for 8 OSDs in device set "ocs-deviceset-0" >2022-11-23 13:29:33.791105 I | op-osd: OSD PVC "ocs-deviceset-0-data-0bwms5" already exists >2022-11-23 13:29:33.791111 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-05l52j" already exists >2022-11-23 13:29:33.791115 I | op-osd: OSD PVC "ocs-deviceset-0-wal-0fpxq2" already exists >2022-11-23 13:29:33.791138 I | op-osd: OSD PVC "ocs-deviceset-0-data-1vd6t2" already exists >2022-11-23 13:29:33.987909 I | op-osd: successfully provisioned PVC "ocs-deviceset-0-metadata-1jdkcg" >2022-11-23 13:29:33.987936 I | op-osd: OSD PVC "ocs-deviceset-0-wal-1r6b2z" already exists >2022-11-23 13:29:33.987944 I | op-osd: OSD PVC "ocs-deviceset-0-data-2fgc98" already exists >2022-11-23 13:29:33.987950 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-2ljqb5" already exists >2022-11-23 13:29:33.987955 I | op-osd: OSD PVC "ocs-deviceset-0-wal-2fmx88" already exists >2022-11-23 13:29:33.987975 I | op-osd: OSD PVC "ocs-deviceset-0-data-38bf6x" already exists >2022-11-23 13:29:34.184578 I | op-osd: successfully provisioned PVC "ocs-deviceset-0-metadata-38nb58" >2022-11-23 13:29:34.184597 I | op-osd: OSD PVC "ocs-deviceset-0-wal-3tkdfd" already exists >2022-11-23 13:29:34.184603 I | op-osd: OSD PVC "ocs-deviceset-0-data-4bjtfw" already exists >2022-11-23 13:29:34.184609 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-4fff89" already exists >2022-11-23 13:29:34.184613 I | op-osd: OSD PVC "ocs-deviceset-0-wal-4xgsvz" already exists >2022-11-23 13:29:34.184620 I | op-osd: OSD PVC "ocs-deviceset-0-data-5ks6wf" already exists >2022-11-23 13:29:34.184624 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-5l7x2m" already exists >2022-11-23 13:29:34.184629 I | op-osd: OSD PVC "ocs-deviceset-0-wal-57pv6z" already exists >2022-11-23 13:29:34.184634 I | op-osd: OSD PVC "ocs-deviceset-0-data-6gm2pc" already exists >2022-11-23 13:29:34.385828 I | op-osd: successfully provisioned PVC "ocs-deviceset-0-metadata-6f4z9s" >2022-11-23 13:29:34.385844 I | op-osd: OSD PVC "ocs-deviceset-0-wal-65gnbk" already exists >2022-11-23 13:29:34.385851 I | op-osd: OSD PVC "ocs-deviceset-0-data-7bznfx" already exists >2022-11-23 13:29:34.385856 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-7bdqfj" already exists >2022-11-23 13:29:34.385860 I | op-osd: OSD PVC "ocs-deviceset-0-wal-7jps5n" already exists >2022-11-23 13:29:34.385866 I | op-osd: verifying PVCs exist for 8 OSDs in device set "ocs-deviceset-1" >2022-11-23 13:29:34.385871 I | op-osd: OSD PVC "ocs-deviceset-1-data-1sjmbp" already exists >2022-11-23 13:29:34.385876 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-1nkrbj" already exists >2022-11-23 13:29:34.385883 I | op-osd: OSD PVC "ocs-deviceset-1-wal-14wj6w" already exists >2022-11-23 13:29:34.385889 I | op-osd: OSD PVC "ocs-deviceset-1-data-2kmplq" already exists >2022-11-23 13:29:34.561168 I | op-mgr: successful modules: prometheus >2022-11-23 13:29:34.562438 I | op-config: setting "global"="osd_pool_default_pg_autoscale_mode"="on" option to the mon configuration database >2022-11-23 13:29:34.562542 I | op-mgr: successful modules: dashboard >2022-11-23 13:29:34.585776 I | op-osd: successfully provisioned PVC "ocs-deviceset-1-metadata-2qrzpr" >2022-11-23 13:29:34.585799 I | op-osd: OSD PVC "ocs-deviceset-1-wal-25mhp6" already exists >2022-11-23 13:29:34.585807 I | op-osd: OSD PVC "ocs-deviceset-1-data-39vw7k" already exists >2022-11-23 13:29:34.585813 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-3b5jhh" already exists >2022-11-23 13:29:34.585819 I | op-osd: OSD PVC "ocs-deviceset-1-wal-3rjmpt" already exists >2022-11-23 13:29:34.585824 I | op-osd: OSD PVC "ocs-deviceset-1-data-4bcv2q" already exists >2022-11-23 13:29:34.585830 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-4hl2gm" already exists >2022-11-23 13:29:34.585834 I | op-osd: OSD PVC "ocs-deviceset-1-wal-4jzx9d" already exists >2022-11-23 13:29:34.585839 I | op-osd: OSD PVC "ocs-deviceset-1-data-5fg2rq" already exists >2022-11-23 13:29:34.784933 I | op-osd: successfully provisioned PVC "ocs-deviceset-1-metadata-5mvm8w" >2022-11-23 13:29:34.784957 I | op-osd: OSD PVC "ocs-deviceset-1-wal-5cwqh9" already exists >2022-11-23 13:29:34.784965 I | op-osd: OSD PVC "ocs-deviceset-1-data-6jjq7d" already exists >2022-11-23 13:29:34.784971 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-6w4wgm" already exists >2022-11-23 13:29:34.784976 I | op-osd: OSD PVC "ocs-deviceset-1-wal-62dgpw" already exists >2022-11-23 13:29:34.784984 I | op-osd: OSD PVC "ocs-deviceset-1-data-7kf4tb" already exists >2022-11-23 13:29:34.784988 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-7ll7pw" already exists >2022-11-23 13:29:34.784992 I | op-osd: OSD PVC "ocs-deviceset-1-wal-79jmc9" already exists >2022-11-23 13:29:34.784998 I | op-osd: OSD PVC "ocs-deviceset-1-data-0n9nmx" already exists >2022-11-23 13:29:34.785002 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-0smm8c" already exists >2022-11-23 13:29:34.785006 I | op-osd: OSD PVC "ocs-deviceset-1-wal-04hg6m" already exists >2022-11-23 13:29:34.785011 I | op-osd: verifying PVCs exist for 8 OSDs in device set "ocs-deviceset-2" >2022-11-23 13:29:34.785016 I | op-osd: OSD PVC "ocs-deviceset-2-data-2dtlkq" already exists >2022-11-23 13:29:34.785021 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-2ngfs9" already exists >2022-11-23 13:29:34.785026 I | op-osd: OSD PVC "ocs-deviceset-2-wal-2prbmt" already exists >2022-11-23 13:29:34.785030 I | op-osd: OSD PVC "ocs-deviceset-2-data-39nfvc" already exists >2022-11-23 13:29:34.785035 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-324rgb" already exists >2022-11-23 13:29:34.785039 I | op-osd: OSD PVC "ocs-deviceset-2-wal-3lwhts" already exists >2022-11-23 13:29:34.785044 I | op-osd: OSD PVC "ocs-deviceset-2-data-4qsl7c" already exists >2022-11-23 13:29:34.813587 I | op-config: successfully set "global"="osd_pool_default_pg_autoscale_mode"="on" option to the mon configuration database >2022-11-23 13:29:34.813605 I | op-config: setting "global"="mon_pg_warn_min_per_osd"="0" option to the mon configuration database >2022-11-23 13:29:34.988890 I | op-osd: successfully provisioned PVC "ocs-deviceset-2-metadata-457pkl" >2022-11-23 13:29:34.988912 I | op-osd: OSD PVC "ocs-deviceset-2-wal-4q8dnm" already exists >2022-11-23 13:29:34.988923 I | op-osd: OSD PVC "ocs-deviceset-2-data-56s2sg" already exists >2022-11-23 13:29:34.988946 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-5wczjg" already exists >2022-11-23 13:29:34.988950 I | op-osd: OSD PVC "ocs-deviceset-2-wal-5s226m" already exists >2022-11-23 13:29:34.988954 I | op-osd: OSD PVC "ocs-deviceset-2-data-65vppw" already exists >2022-11-23 13:29:34.988959 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-6mlfv7" already exists >2022-11-23 13:29:34.988963 I | op-osd: OSD PVC "ocs-deviceset-2-wal-6qtnqg" already exists >2022-11-23 13:29:34.988967 I | op-osd: OSD PVC "ocs-deviceset-2-data-72v4qp" already exists >2022-11-23 13:29:34.988973 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-7l8wjf" already exists >2022-11-23 13:29:34.988984 I | op-osd: OSD PVC "ocs-deviceset-2-wal-7nf8xz" already exists >2022-11-23 13:29:34.988989 I | op-osd: OSD PVC "ocs-deviceset-2-data-0dt89f" already exists >2022-11-23 13:29:34.988993 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-0ghkfb" already exists >2022-11-23 13:29:34.988996 I | op-osd: OSD PVC "ocs-deviceset-2-wal-0m6ldf" already exists >2022-11-23 13:29:34.989000 I | op-osd: OSD PVC "ocs-deviceset-2-data-1sg95c" already exists >2022-11-23 13:29:35.070312 I | op-config: successfully set "global"="mon_pg_warn_min_per_osd"="0" option to the mon configuration database >2022-11-23 13:29:35.185723 I | op-osd: successfully provisioned PVC "ocs-deviceset-2-metadata-1fdt8m" >2022-11-23 13:29:35.185743 I | op-osd: OSD PVC "ocs-deviceset-2-wal-1qgp84" already exists >2022-11-23 13:29:35.239613 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-0bwms5" and its metadata device on "ocs-deviceset-0-metadata-05l52j" >2022-11-23 13:29:35.239628 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-0fpxq2" >2022-11-23 13:29:35.239632 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-0bwms5" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239634 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-1vd6t2" and its metadata device on "ocs-deviceset-0-metadata-1jdkcg" >2022-11-23 13:29:35.239636 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-1r6b2z" >2022-11-23 13:29:35.239639 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-1vd6t2" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239642 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-2fgc98" and its metadata device on "ocs-deviceset-0-metadata-2ljqb5" >2022-11-23 13:29:35.239644 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-2fmx88" >2022-11-23 13:29:35.239646 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-2fgc98" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239649 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-38bf6x" and its metadata device on "ocs-deviceset-0-metadata-38nb58" >2022-11-23 13:29:35.239650 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-3tkdfd" >2022-11-23 13:29:35.239668 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-38bf6x" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239671 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-4bjtfw" and its metadata device on "ocs-deviceset-0-metadata-4fff89" >2022-11-23 13:29:35.239673 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-4xgsvz" >2022-11-23 13:29:35.239675 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-4bjtfw" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239677 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-5ks6wf" and its metadata device on "ocs-deviceset-0-metadata-5l7x2m" >2022-11-23 13:29:35.239679 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-57pv6z" >2022-11-23 13:29:35.239681 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-5ks6wf" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239683 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-6gm2pc" and its metadata device on "ocs-deviceset-0-metadata-6f4z9s" >2022-11-23 13:29:35.239686 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-65gnbk" >2022-11-23 13:29:35.239688 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-6gm2pc" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239690 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-7bznfx" and its metadata device on "ocs-deviceset-0-metadata-7bdqfj" >2022-11-23 13:29:35.239692 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-7jps5n" >2022-11-23 13:29:35.239694 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-7bznfx" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239696 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-1sjmbp" and its metadata device on "ocs-deviceset-1-metadata-1nkrbj" >2022-11-23 13:29:35.239698 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-14wj6w" >2022-11-23 13:29:35.239700 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-1sjmbp" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239702 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-2kmplq" and its metadata device on "ocs-deviceset-1-metadata-2qrzpr" >2022-11-23 13:29:35.239703 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-25mhp6" >2022-11-23 13:29:35.239705 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-2kmplq" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239707 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-39vw7k" and its metadata device on "ocs-deviceset-1-metadata-3b5jhh" >2022-11-23 13:29:35.239709 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-3rjmpt" >2022-11-23 13:29:35.239711 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-39vw7k" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239713 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-4bcv2q" and its metadata device on "ocs-deviceset-1-metadata-4hl2gm" >2022-11-23 13:29:35.239715 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-4jzx9d" >2022-11-23 13:29:35.239720 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-4bcv2q" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239722 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-5fg2rq" and its metadata device on "ocs-deviceset-1-metadata-5mvm8w" >2022-11-23 13:29:35.239724 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-5cwqh9" >2022-11-23 13:29:35.239726 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-5fg2rq" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239729 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-6jjq7d" and its metadata device on "ocs-deviceset-1-metadata-6w4wgm" >2022-11-23 13:29:35.239731 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-62dgpw" >2022-11-23 13:29:35.239733 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-6jjq7d" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239736 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-7kf4tb" and its metadata device on "ocs-deviceset-1-metadata-7ll7pw" >2022-11-23 13:29:35.239738 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-79jmc9" >2022-11-23 13:29:35.239739 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-7kf4tb" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239742 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-0n9nmx" and its metadata device on "ocs-deviceset-1-metadata-0smm8c" >2022-11-23 13:29:35.239744 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-04hg6m" >2022-11-23 13:29:35.239746 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-0n9nmx" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239748 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-2dtlkq" and its metadata device on "ocs-deviceset-2-metadata-2ngfs9" >2022-11-23 13:29:35.239750 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-2prbmt" >2022-11-23 13:29:35.239754 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-2dtlkq" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239758 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-39nfvc" and its metadata device on "ocs-deviceset-2-metadata-324rgb" >2022-11-23 13:29:35.239760 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-3lwhts" >2022-11-23 13:29:35.239762 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-39nfvc" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239764 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-4qsl7c" and its metadata device on "ocs-deviceset-2-metadata-457pkl" >2022-11-23 13:29:35.239767 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-4q8dnm" >2022-11-23 13:29:35.239769 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-4qsl7c" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239771 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-56s2sg" and its metadata device on "ocs-deviceset-2-metadata-5wczjg" >2022-11-23 13:29:35.239773 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-5s226m" >2022-11-23 13:29:35.239776 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-56s2sg" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239778 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-65vppw" and its metadata device on "ocs-deviceset-2-metadata-6mlfv7" >2022-11-23 13:29:35.239780 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-6qtnqg" >2022-11-23 13:29:35.239782 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-65vppw" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239785 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-72v4qp" and its metadata device on "ocs-deviceset-2-metadata-7l8wjf" >2022-11-23 13:29:35.239787 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-7nf8xz" >2022-11-23 13:29:35.239789 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-72v4qp" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239791 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-0dt89f" and its metadata device on "ocs-deviceset-2-metadata-0ghkfb" >2022-11-23 13:29:35.239793 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-0m6ldf" >2022-11-23 13:29:35.239795 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-0dt89f" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239797 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-1sg95c" and its metadata device on "ocs-deviceset-2-metadata-1fdt8m" >2022-11-23 13:29:35.239799 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-1qgp84" >2022-11-23 13:29:35.239801 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-1sg95c" because OSD daemon using the PVC already exists >2022-11-23 13:29:35.239803 I | op-osd: start provisioning the OSDs on nodes, if needed >2022-11-23 13:29:35.239805 I | op-osd: no nodes are defined for configuring OSDs on raw devices >2022-11-23 13:29:35.819410 I | op-mgr: successful modules: mgr module(s) from the spec >2022-11-23 13:29:36.483121 I | op-osd: OSD 0 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 13:29:36.487520 I | op-osd: updating OSD 0 on PVC "ocs-deviceset-0-data-0bwms5" >2022-11-23 13:29:36.487537 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-0bwms5" and its metadata device on "ocs-deviceset-0-metadata-05l52j" >2022-11-23 13:29:36.487542 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-0fpxq2" >2022-11-23 13:29:36.488069 I | op-osd: assigning osd 0 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 13:29:37.600209 I | op-osd: OSD 1 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 13:29:37.605515 I | op-osd: updating OSD 1 on PVC "ocs-deviceset-0-data-2fgc98" >2022-11-23 13:29:37.605529 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-2fgc98" and its metadata device on "ocs-deviceset-0-metadata-2ljqb5" >2022-11-23 13:29:37.605533 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-2fmx88" >2022-11-23 13:29:37.605752 I | op-osd: assigning osd 1 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 13:29:38.747275 I | op-osd: OSD 10 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 13:29:38.753589 I | op-osd: updating OSD 10 on PVC "ocs-deviceset-1-data-4bcv2q" >2022-11-23 13:29:38.753608 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-4bcv2q" and its metadata device on "ocs-deviceset-1-metadata-4hl2gm" >2022-11-23 13:29:38.753611 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-4jzx9d" >2022-11-23 13:29:38.753809 I | op-osd: assigning osd 10 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 13:29:39.914440 I | op-osd: updating OSD 11 on PVC "ocs-deviceset-1-data-2kmplq" >2022-11-23 13:29:39.914460 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-2kmplq" and its metadata device on "ocs-deviceset-1-metadata-2qrzpr" >2022-11-23 13:29:39.914464 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-25mhp6" >2022-11-23 13:29:39.914644 I | op-osd: assigning osd 11 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 13:29:44.246749 I | op-mon: checking if multiple mons are on the same node >2022-11-23 13:29:49.091851 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:29:49.091953 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:29:49.091968 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:29:49.091982 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:29:49.091996 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:29:49.092008 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:29:49.092019 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:29:49.397641 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 13:29:49.687415 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:29:49.687444 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:29:49.687476 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:29:49.687489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:29:49.687505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:29:49.687521 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:29:49.687533 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:29:49.988420 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 13:30:19.658043 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:30:19.658139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:30:19.658157 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:30:19.658172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:30:19.658188 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:30:19.658204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:30:19.658217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:30:19.975987 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 13:30:20.263157 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:30:20.263191 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:30:20.263205 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:30:20.263218 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:30:20.263234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:30:20.263316 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:30:20.263335 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:30:20.568843 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 13:30:24.151068 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:30:24.151093 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:30:24.151109 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:30:24.151184 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:30:24.151199 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:30:24.151214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:30:24.151239 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:30:24.456456 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 13:30:50.263999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:30:50.264031 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:30:50.264049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:30:50.264063 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:30:50.264075 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:30:50.264090 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:30:50.264189 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:30:50.563525 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:30:50.836946 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:30:50.837058 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:30:50.837080 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:30:50.837097 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:30:50.837115 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:30:50.837130 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:30:50.837145 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:30:51.141192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:31:20.819957 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:31:20.819990 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:31:20.820013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:31:20.820033 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:31:20.820139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:31:20.820163 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:31:20.820184 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:31:21.118396 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:31:21.403226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:31:21.403264 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:31:21.403285 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:31:21.403304 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:31:21.403328 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:31:21.403349 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:31:21.403370 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:31:21.698978 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:31:24.283416 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:31:24.283446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:31:24.283462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:31:24.283557 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:31:24.283574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:31:24.283590 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:31:24.283604 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:31:24.594679 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:31:51.379886 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:31:51.379919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:31:51.379935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:31:51.380025 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:31:51.380041 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:31:51.380059 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:31:51.380073 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:31:51.685131 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:31:51.958705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:31:51.958744 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:31:51.958758 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:31:51.958772 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:31:51.958853 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:31:51.958869 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:31:51.958883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:31:52.293696 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:32:21.954708 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:32:21.954746 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:32:21.954775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:32:21.954865 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:32:21.954883 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:32:21.954897 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:32:21.954910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:32:22.273844 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:32:22.559107 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:32:22.559139 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:32:22.559153 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:32:22.559236 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:32:22.559253 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:32:22.559268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:32:22.559282 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:32:22.865697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:32:24.408732 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:32:24.408821 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:32:24.408837 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:32:24.408853 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:32:24.408872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:32:24.408884 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:32:24.408897 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:32:24.716445 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:32:52.539133 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:32:52.539235 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:32:52.539266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:32:52.539291 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:32:52.539319 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:32:52.539352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:32:52.539658 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:32:52.848811 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:32:53.122819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:32:53.122853 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:32:53.122868 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:32:53.122975 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:32:53.122990 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:32:53.123004 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:32:53.123018 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:32:53.430236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:33:23.110028 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:33:23.110056 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:33:23.110074 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:33:23.110094 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:33:23.110109 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:33:23.110122 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:33:23.110135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:33:23.415831 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:33:23.692637 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:33:23.692666 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:33:23.692681 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:33:23.692694 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:33:23.692708 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:33:23.692818 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:33:23.692841 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:33:24.001336 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:33:24.538344 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:33:24.538387 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:33:24.538403 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:33:24.538420 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:33:24.538434 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:33:24.538448 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:33:24.538546 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:33:24.841812 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:33:53.680505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:33:53.680534 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:33:53.680565 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:33:53.680654 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:33:53.680669 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:33:53.680687 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:33:53.680704 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:33:53.983058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:33:54.268317 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:33:54.268349 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:33:54.268362 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:33:54.268374 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:33:54.268386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:33:54.268479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:33:54.268493 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:33:54.575521 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:34:24.253182 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:34:24.253230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:34:24.253245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:34:24.253279 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:34:24.253364 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:34:24.253381 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:34:24.253398 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:34:24.558656 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:34:24.829451 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:34:24.829543 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:34:24.829561 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:34:24.829577 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:34:24.829595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:34:24.829612 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:34:24.829625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:34:25.145538 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:34:25.407082 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:34:25.407222 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:34:25.407249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:34:25.407268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:34:25.407287 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:34:25.407308 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:34:25.407327 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:34:25.708480 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:34:54.830838 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:34:54.830871 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:34:54.830888 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:34:54.830901 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:34:54.830929 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:34:54.831017 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:34:54.831030 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:34:55.147519 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:34:55.961951 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:34:55.961997 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:34:55.962016 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:34:55.962030 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:34:55.962046 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:34:55.962072 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:34:55.962086 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:34:56.258710 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:35:24.798472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:35:24.798544 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:35:24.798572 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:35:24.798599 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:35:24.798624 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:35:24.798866 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:35:24.798913 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:35:25.110951 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:35:25.406500 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:35:25.406609 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:35:25.406626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:35:25.406643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:35:25.406660 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:35:25.406675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:35:25.406690 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:35:25.706406 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:35:26.524287 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:35:26.524316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:35:26.524333 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:35:26.524347 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:35:26.524360 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:35:26.524371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:35:26.524462 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:35:26.823158 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:35:55.968764 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:35:55.968795 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:35:55.968812 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:35:55.968826 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:35:55.968842 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:35:55.968855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:35:55.968869 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:35:56.273689 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:35:57.083605 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:35:57.083634 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:35:57.083665 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:35:57.083765 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:35:57.083785 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:35:57.083800 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:35:57.083816 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:35:57.380696 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:36:24.928052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:36:24.928090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:36:24.928106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:36:24.928120 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:36:24.928135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:36:24.928147 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:36:24.928158 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:36:25.247764 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:36:26.529276 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:36:26.529307 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:36:26.529338 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:36:26.529356 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:36:26.529370 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:36:26.529381 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:36:26.529484 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:36:26.831582 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:36:27.637392 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:36:27.637421 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:36:27.637454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:36:27.637467 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:36:27.637480 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:36:27.637496 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:36:27.637590 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:36:27.937963 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:36:57.090900 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:36:57.090930 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:36:57.090946 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:36:57.090959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:36:57.091062 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:36:57.091079 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:36:57.091092 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:36:57.393122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:36:58.208118 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:36:58.208152 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:36:58.208166 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:36:58.208180 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:36:58.208257 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:36:58.208271 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:36:58.208285 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:36:58.509659 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:37:25.059910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:37:25.059940 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:37:25.059956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:37:25.059972 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:37:25.060065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:37:25.060080 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:37:25.060095 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:37:25.366215 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:37:27.651053 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:37:27.651104 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:37:27.651118 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:37:27.651212 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:37:27.651227 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:37:27.651240 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:37:27.651255 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:37:27.952620 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:37:28.772254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:37:28.772289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:37:28.772304 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:37:28.772317 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:37:28.772330 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:37:28.772344 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:37:28.772432 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:37:29.086202 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:37:58.223217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:37:58.223253 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:37:58.223266 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:37:58.223345 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:37:58.223363 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:37:58.223378 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:37:58.223390 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:37:58.527497 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:37:59.348650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:37:59.348682 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:37:59.348699 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:37:59.348713 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:37:59.348730 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:37:59.348814 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:37:59.348830 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:37:59.658731 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:38:25.188458 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:38:25.188484 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:38:25.188500 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:38:25.188516 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:38:25.188610 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:38:25.188626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:38:25.188640 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:38:25.494908 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:38:28.787899 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:38:28.787941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:38:28.787965 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:38:28.787977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:38:28.787987 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:38:28.788001 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:38:28.788091 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:38:29.092367 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:38:29.921080 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:38:29.921209 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:38:29.921226 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:38:29.921246 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:38:29.921261 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:38:29.921274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:38:29.921288 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:38:30.244211 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:38:59.357826 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:38:59.357862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:38:59.357878 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:38:59.357892 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:38:59.357908 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:38:59.357925 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:38:59.358026 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:38:59.665671 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:39:00.509148 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:39:00.509180 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:39:00.509194 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:39:00.509275 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:39:00.509292 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:39:00.509306 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:39:00.509320 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:39:00.813092 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:39:25.318479 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:39:25.318507 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:39:25.318523 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:39:25.318537 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:39:25.318549 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:39:25.318561 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:39:25.318639 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:39:25.628685 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:39:29.932146 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:39:29.932176 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:39:29.932190 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:39:29.932299 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:39:29.932313 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:39:29.932338 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:39:29.932352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:39:30.253318 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:39:31.078447 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:39:31.078478 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:39:31.078511 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:39:31.078525 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:39:31.078542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:39:31.078558 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:39:31.078570 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:39:31.378825 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:40:00.518337 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:40:00.518442 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:40:00.518456 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:40:00.518471 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:40:00.518485 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:40:00.518502 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:40:00.518517 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:40:00.827108 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:40:01.635774 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:40:01.635824 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:40:01.635845 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:40:01.635864 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:40:01.635884 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:40:01.635903 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:40:01.635922 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:40:01.942990 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:40:25.448627 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:40:25.448662 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:40:25.448676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:40:25.448790 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:40:25.448806 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:40:25.448823 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:40:25.448837 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:40:25.746704 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:40:31.089034 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:40:31.089144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:40:31.089158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:40:31.089173 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:40:31.089189 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:40:31.089204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:40:31.089217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:40:31.391288 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:40:32.222779 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:40:32.222810 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:40:32.222823 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:40:32.222896 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:40:32.222914 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:40:32.222929 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:40:32.222943 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:40:32.525505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:41:01.650562 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:41:01.650594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:41:01.650627 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:41:01.650728 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:41:01.650748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:41:01.650764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:41:01.650778 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:41:01.965706 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:41:02.784711 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:41:02.784749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:41:02.784762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:41:02.784776 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:41:02.784869 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:41:02.784886 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:41:02.784900 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:41:03.093383 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:41:25.577291 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:41:25.577407 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:41:25.578005 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:41:25.578036 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:41:25.578057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:41:25.578075 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:41:25.578093 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:41:25.884320 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:41:32.267741 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:41:32.267858 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:41:32.267874 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:41:32.267891 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:41:32.267905 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:41:32.267919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:41:32.267933 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:41:32.566297 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:41:33.355344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:41:33.355376 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:41:33.355391 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:41:33.355403 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:41:33.355415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:41:33.355494 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:41:33.355508 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:41:33.665106 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:42:02.827941 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:42:02.827996 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:42:02.828012 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:42:02.828027 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:42:02.828039 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:42:02.828055 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:42:02.828142 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:42:03.140824 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:42:03.924299 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:42:03.924330 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:42:03.924347 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:42:03.924449 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:42:03.924468 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:42:03.924486 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:42:03.924498 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:42:04.229120 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:42:25.704535 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:42:25.704564 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:42:25.704597 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:42:25.704693 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:42:25.704708 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:42:25.704735 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:42:25.704757 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:42:26.006755 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:42:33.401024 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:42:33.401135 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:42:33.401149 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:42:33.401165 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:42:33.401180 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:42:33.401193 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:42:33.401204 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:42:33.703511 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:42:34.493783 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:42:34.493879 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:42:34.493896 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:42:34.493910 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:42:34.493923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:42:34.493938 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:42:34.493950 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:42:34.803353 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:43:03.964178 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:43:03.964293 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:43:03.964308 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:43:03.964322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:43:03.964339 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:43:03.964353 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:43:03.964365 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:43:04.268388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:43:05.065485 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:43:05.065520 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:43:05.065535 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:43:05.065631 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:43:05.065647 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:43:05.065663 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:43:05.065678 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:43:05.367858 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:43:25.834096 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:43:25.834185 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:43:25.834201 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:43:25.834217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:43:25.834231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:43:25.834246 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:43:25.834259 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:43:26.143714 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:43:34.523513 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:43:34.523543 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:43:34.523560 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:43:34.523573 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:43:34.523585 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:43:34.523670 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:43:34.523685 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:43:34.832690 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:43:35.633490 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:43:35.633520 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:43:35.633534 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:43:35.633548 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:43:35.633562 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:43:35.633575 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:43:35.633649 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:43:35.937440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:44:05.103992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:44:05.104537 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:44:05.104568 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:44:05.104592 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:44:05.104608 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:44:05.104630 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:44:05.104648 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:44:05.414671 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:44:06.204061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:44:06.204090 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:44:06.204105 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:44:06.204203 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:44:06.204219 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:44:06.204235 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:44:06.204250 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:44:06.508788 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:44:25.961614 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:44:25.961639 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:44:25.961653 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:44:25.961666 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:44:25.961774 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:44:25.961789 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:44:25.961803 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:44:26.278015 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:44:35.668754 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:44:35.668786 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:44:35.668801 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:44:35.668892 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:44:35.668909 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:44:35.668924 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:44:35.668939 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:44:35.976986 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:44:36.778994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:44:36.779029 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:44:36.779046 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:44:36.779188 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:44:36.779207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:44:36.779225 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:44:36.779239 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:44:37.078264 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:45:06.246235 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:45:06.246343 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:45:06.246359 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:45:06.246376 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:45:06.246390 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:45:06.246404 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:45:06.246417 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:45:06.559549 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:45:07.337578 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:45:07.337680 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:45:07.337697 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:45:07.337710 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:45:07.337730 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:45:07.337747 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:45:07.337761 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:45:07.642205 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:45:26.085833 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:45:26.085874 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:45:26.085905 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:45:26.085985 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:45:26.086001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:45:26.086017 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:45:26.086031 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:45:26.395900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:45:36.822294 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:45:36.822326 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:45:36.822340 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:45:36.822420 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:45:36.822436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:45:36.822451 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:45:36.822467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:45:37.125440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:45:37.899980 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:45:37.900011 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:45:37.900025 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:45:37.900038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:45:37.900054 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:45:37.900128 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:45:37.900141 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:45:38.207632 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:46:07.386630 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:46:07.386742 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:46:07.386759 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:46:07.386773 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:46:07.386786 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:46:07.386801 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:46:07.386825 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:46:07.703194 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:46:08.468692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:46:08.468795 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:46:08.468813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:46:08.468827 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:46:08.468841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:46:08.468858 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:46:08.468872 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:46:08.772344 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:46:26.209905 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:46:26.209930 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:46:26.209946 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:46:26.210046 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:46:26.210062 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:46:26.210093 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:46:26.210106 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:46:26.515052 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:46:37.983950 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:46:37.983979 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:46:37.983996 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:46:37.984089 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:46:37.984105 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:46:37.984131 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:46:37.984145 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:46:38.283060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:46:39.035860 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:46:39.035957 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:46:39.035974 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:46:39.035988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:46:39.036001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:46:39.036016 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:46:39.036030 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:46:39.350801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:47:08.545219 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:47:08.545246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:47:08.545260 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:47:08.545360 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:47:08.545376 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:47:08.545402 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:47:08.545416 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:47:08.842561 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:47:09.611357 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:47:09.611384 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:47:09.611398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:47:09.611413 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:47:09.611426 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:47:09.611442 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:47:09.611522 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:47:09.916866 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:47:26.335857 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:47:26.335883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:47:26.335897 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:47:26.335910 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:47:26.335925 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:47:26.335936 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:47:26.336011 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:47:26.644997 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:47:39.105733 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:47:39.105764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:47:39.105778 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:47:39.105793 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:47:39.105808 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:47:39.105820 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:47:39.105916 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:47:39.427667 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:47:39.460202 E | op-osd: failed to update OSD deployment "rook-ceph-osd-11": progress deadline exceeded on deployment "rook-ceph-osd-11": gave up waiting for deployment "rook-ceph-osd-11" to update because "ProgressDeadlineExceeded" >2022-11-23 13:47:39.460224 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 4 of 24 OSDs have been updated >2022-11-23 13:47:40.190960 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:47:40.190995 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:47:40.191011 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:47:40.191025 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 13:47:40.191120 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:47:40.191138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:47:40.191151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:47:40.499740 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:47:40.565500 I | op-osd: OSD 12 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 13:47:40.571427 I | op-osd: updating OSD 12 on PVC "ocs-deviceset-1-data-6jjq7d" >2022-11-23 13:47:40.571446 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-6jjq7d" and its metadata device on "ocs-deviceset-1-metadata-6w4wgm" >2022-11-23 13:47:40.571452 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-62dgpw" >2022-11-23 13:47:40.572202 I | op-osd: assigning osd 12 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 13:47:41.726116 I | op-osd: updating OSD 13 on PVC "ocs-deviceset-1-data-5fg2rq" >2022-11-23 13:47:41.726139 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-5fg2rq" and its metadata device on "ocs-deviceset-1-metadata-5mvm8w" >2022-11-23 13:47:41.726143 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-5cwqh9" >2022-11-23 13:47:41.726326 I | op-osd: assigning osd 13 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 13:48:09.693031 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:48:09.693061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:48:09.693078 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:48:09.693091 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:48:09.693164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:48:09.693234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:48:09.693247 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:48:09.999877 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:48:10.766599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:48:10.766635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:48:10.766657 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:48:10.766676 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:48:10.766696 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:48:10.766802 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:48:10.766870 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:48:11.085437 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:48:26.460352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:48:26.460442 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:48:26.460457 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:48:26.460473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:48:26.460488 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:48:26.460502 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:48:26.460516 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:48:26.762367 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:48:40.277818 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:48:40.277858 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:48:40.277890 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:48:40.277903 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:48:40.277920 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:48:40.277933 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:48:40.277994 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:48:40.583699 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:48:41.360332 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:48:41.360364 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:48:41.360378 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:48:41.360393 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:48:41.360405 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:48:41.360476 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:48:41.360557 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:48:41.666068 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:49:10.843972 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:49:10.844060 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:49:10.844077 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:49:10.844092 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:49:10.844106 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:49:10.844121 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:49:10.844134 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:49:11.158794 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:49:11.924891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:49:11.924920 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:49:11.924934 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:49:11.925018 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:49:11.925083 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:49:11.925117 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:49:11.925131 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:49:12.238572 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:49:26.581726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:49:26.581756 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:49:26.581771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:49:26.581849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:49:26.581912 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:49:26.581930 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:49:26.581944 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:49:26.888922 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:49:41.417915 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:49:41.417948 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:49:41.417965 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:49:41.417979 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:49:41.417992 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:49:41.418006 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:49:41.418069 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:49:41.726246 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:49:42.502617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:49:42.502709 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:49:42.502735 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:49:42.502766 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:49:42.502781 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:49:42.502796 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:49:42.502813 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:49:42.798739 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:50:12.000645 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:50:12.000677 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:50:12.000692 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:50:12.000707 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:50:12.000725 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:50:12.000738 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:50:12.000811 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:50:12.339028 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:50:13.060569 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:50:13.060600 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:50:13.060689 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:50:13.060760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:50:13.060776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:50:13.060793 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:50:13.060807 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:50:13.364705 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:50:26.707609 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:50:26.707694 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:50:26.707713 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:50:26.707734 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:50:26.707747 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:50:26.707760 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:50:26.707772 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:50:27.018753 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:50:42.607494 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:50:42.607593 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:50:42.607612 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:50:42.607626 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:50:42.607639 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:50:42.607654 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:50:42.607667 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:50:42.912305 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:50:43.623943 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:50:43.624021 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:50:43.624037 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:50:43.624049 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:50:43.624066 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:50:43.624079 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:50:43.624092 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:50:43.938314 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:51:13.180753 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:51:13.180787 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:51:13.180802 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:51:13.180818 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:51:13.180833 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:51:13.180849 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:51:13.180919 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:51:13.490061 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:51:14.209310 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:51:14.209346 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:51:14.209364 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:51:14.209388 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:51:14.209408 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:51:14.209503 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:51:14.209579 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:51:14.520212 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:51:26.832457 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:51:26.832543 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:51:26.832559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:51:26.832575 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:51:26.832590 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:51:26.832604 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:51:26.832619 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:51:27.141065 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:51:43.754444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:51:43.754477 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:51:43.754492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:51:43.754505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:51:43.754600 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:51:43.754671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:51:43.754686 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:51:44.065322 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:51:44.779714 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:51:44.779754 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:51:44.779771 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:51:44.779785 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:51:44.779800 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:51:44.779813 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:51:44.779874 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:51:45.091028 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:52:14.334420 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:52:14.334450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:52:14.334465 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:52:14.334481 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:52:14.334564 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:52:14.334627 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:52:14.334642 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:52:14.641811 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:52:15.353635 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:52:15.353665 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:52:15.353755 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:52:15.353816 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:52:15.353832 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:52:15.353857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:52:15.353871 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:52:15.657676 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:52:26.953942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:52:26.953972 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:52:26.953986 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:52:26.954059 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:52:26.954117 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:52:26.954133 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:52:26.954147 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:52:27.271509 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:52:44.910821 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:52:44.910881 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:52:44.910901 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:52:44.910918 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:52:44.910932 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:52:44.911052 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:52:44.911159 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:52:45.211391 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:52:45.917801 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:52:45.917831 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:52:45.917846 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:52:45.917859 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:52:45.917872 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:52:45.917957 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:52:45.918028 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:52:46.220929 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:53:15.470655 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:53:15.470776 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:53:15.470796 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:53:15.470811 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:53:15.470825 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:53:15.470841 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:53:15.470856 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:53:15.767666 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:53:16.488433 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:53:16.488463 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:53:16.488581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:53:16.488672 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:53:16.488689 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:53:16.488704 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:53:16.488724 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:53:16.788674 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:53:27.075073 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:53:27.075177 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:53:27.075193 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:53:27.075211 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:53:27.075226 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:53:27.075242 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:53:27.075255 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:53:27.385949 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:53:46.034151 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:53:46.034181 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:53:46.034278 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:53:46.034357 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:53:46.034373 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:53:46.034386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:53:46.034403 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:53:46.348972 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:53:47.047676 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:53:47.047707 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:53:47.047793 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:53:47.047870 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:53:47.047885 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:53:47.047901 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:53:47.047927 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:53:47.357160 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:54:16.610457 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:54:16.610491 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:54:16.610507 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:54:16.610523 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:54:16.610536 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:54:16.610637 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:54:16.610714 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:54:16.911370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:54:17.630405 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:54:17.630438 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:54:17.630455 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:54:17.630468 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:54:17.630483 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:54:17.630498 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:54:17.630574 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:54:17.938083 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:54:27.194019 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:54:27.194049 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:54:27.194064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:54:27.194159 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:54:27.194254 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:54:27.194272 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:54:27.194289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:54:27.492001 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:54:47.169205 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:54:47.169324 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:54:47.169341 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:54:47.169355 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:54:47.169371 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:54:47.169385 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:54:47.169396 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:54:47.465666 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:54:48.202203 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:54:48.202233 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:54:48.202318 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:54:48.202378 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:54:48.202397 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:54:48.202413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:54:48.202427 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:54:48.509338 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:55:17.731515 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:55:17.731548 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:55:17.731561 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:55:17.731652 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:55:17.731729 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:55:17.731745 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:55:17.731760 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:55:18.038673 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:55:18.772945 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:55:18.773040 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:55:18.773057 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:55:18.773074 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:55:18.773089 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:55:18.773104 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:55:18.773116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:55:19.077011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:55:27.316969 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:55:27.317000 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:55:27.317102 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:55:27.317183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:55:27.317199 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:55:27.317215 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:55:27.317231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:55:27.620967 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:55:48.300172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:55:48.300205 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:55:48.300222 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:55:48.300237 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:55:48.300320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:55:48.300395 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:55:48.300413 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:55:48.614778 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:55:49.346065 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:55:49.346113 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:55:49.346128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:55:49.346202 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:55:49.346264 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:55:49.346280 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:55:49.346295 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:55:49.654199 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:56:18.874349 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:56:18.874435 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:56:18.874464 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:56:18.874480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:56:18.874494 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:56:18.874509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:56:18.874522 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:56:19.186442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:56:19.919428 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:56:19.919461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:56:19.919541 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:56:19.919608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:56:19.919626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:56:19.919650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:56:19.919662 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:56:20.237346 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:56:27.398798 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:56:27.398826 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:56:27.398840 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:56:27.398914 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:56:27.398970 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:56:27.398986 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:56:27.399001 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:56:27.704555 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:56:49.453427 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:56:49.453526 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:56:49.453540 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:56:49.453555 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:56:49.453569 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:56:49.453581 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:56:49.453594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:56:49.757635 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:56:50.498818 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:56:50.498854 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:56:50.498870 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:56:50.498883 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:56:50.498973 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:56:50.499034 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:56:50.499049 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:56:50.801991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:57:20.021269 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:57:20.021300 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:57:20.021314 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:57:20.021400 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:57:20.021458 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:57:20.021471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:57:20.021484 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:57:20.337641 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:57:21.062322 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:57:21.062354 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:57:21.062450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:57:21.062523 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:57:21.062541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:57:21.062556 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:57:21.062572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:57:21.361403 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:57:27.518922 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 13:57:27.518950 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:57:27.519046 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:57:27.519126 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:57:27.519142 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:57:27.519160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:57:27.519174 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:57:27.821186 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:57:44.023461 E | op-osd: failed to update OSD deployment "rook-ceph-osd-13": progress deadline exceeded on deployment "rook-ceph-osd-13": gave up waiting for deployment "rook-ceph-osd-13" to update because "ProgressDeadlineExceeded" >2022-11-23 13:57:44.023486 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 6 of 24 OSDs have been updated >2022-11-23 13:57:45.122640 I | op-osd: OSD 14 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 13:57:45.129028 I | op-osd: updating OSD 14 on PVC "ocs-deviceset-2-data-0dt89f" >2022-11-23 13:57:45.129049 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-0dt89f" and its metadata device on "ocs-deviceset-2-metadata-0ghkfb" >2022-11-23 13:57:45.129053 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-0m6ldf" >2022-11-23 13:57:45.129301 I | op-osd: assigning osd 14 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 13:57:46.279659 I | op-osd: updating OSD 15 on PVC "ocs-deviceset-2-data-1sg95c" >2022-11-23 13:57:46.279680 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-1sg95c" and its metadata device on "ocs-deviceset-2-metadata-1fdt8m" >2022-11-23 13:57:46.279684 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-1qgp84" >2022-11-23 13:57:46.279889 I | op-osd: assigning osd 15 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 13:57:50.598652 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:57:50.598778 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 13:57:50.598858 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:57:50.598933 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:57:50.598949 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:57:50.598968 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:57:50.598982 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:57:50.895953 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:57:51.618752 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 13:57:51.618789 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:57:51.618905 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:57:51.618983 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:57:51.619002 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:57:51.619016 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:57:51.619031 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:57:51.927996 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:58:21.161996 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 13:58:21.162040 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:58:21.162135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:58:21.162251 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:58:21.162268 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:58:21.162289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:58:21.162307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:58:21.475712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:58:22.211315 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 13:58:22.211348 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:58:22.211447 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:58:22.211523 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:58:22.211542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:58:22.211559 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:58:22.211576 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:58:22.518804 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:58:27.637388 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 13:58:27.637414 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:58:27.637516 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:58:27.637589 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:58:27.637607 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:58:27.637625 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:58:27.637640 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:58:27.939393 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:58:51.738037 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 13:58:51.738067 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:58:51.738161 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:58:51.738237 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:58:51.738257 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:58:51.738273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:58:51.738287 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:58:52.049202 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:58:52.789132 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:58:52.789161 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:58:52.789178 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:58:52.789280 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 13:58:52.789361 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:58:52.789437 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:58:52.789453 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:58:53.089670 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:59:22.330931 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:59:22.330962 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:59:22.331067 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 13:59:22.331082 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:59:22.331155 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:59:22.331245 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:59:22.331261 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:59:22.635425 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:59:23.360706 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 13:59:23.360742 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:59:23.360843 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:59:23.360912 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:59:23.360928 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:59:23.360944 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:59:23.360961 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:59:23.662028 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:59:27.765037 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:59:27.765842 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:59:27.765899 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:59:27.765919 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:59:27.765937 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:59:27.766046 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 13:59:27.766063 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:59:28.065375 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:59:52.891599 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:59:52.891631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:59:52.891650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:59:52.891663 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:59:52.891743 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 13:59:52.891777 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:59:52.891855 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:59:53.192625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 13:59:53.918315 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 13:59:53.918345 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 13:59:53.918377 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 13:59:53.918394 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 13:59:53.918469 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 13:59:53.918486 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 13:59:53.918562 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 13:59:54.224456 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:00:23.450429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:00:23.450457 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:00:23.450489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:00:23.450505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:00:23.450610 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:00:23.450686 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:00:23.450780 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:00:23.750280 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:00:24.483563 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:00:24.483595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:00:24.483706 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:00:24.483727 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:00:24.483820 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:00:24.483895 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:00:24.483910 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:00:24.791678 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:00:27.881664 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:00:27.881691 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:00:27.881732 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:00:27.881746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:00:27.881761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:00:27.881841 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:00:27.881916 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:00:28.182319 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:00:54.012153 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:00:54.012196 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:00:54.012214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:00:54.012229 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:00:54.012305 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:00:54.012321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:00:54.012400 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:00:54.322738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:00:55.061342 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:00:55.061374 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:00:55.061447 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:00:55.061531 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:00:55.061551 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:00:55.061568 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:00:55.061583 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:00:55.362610 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:01:24.583351 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:01:24.583384 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:01:24.583460 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:01:24.583534 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:01:24.583552 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:01:24.583566 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:01:24.583584 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:01:24.889767 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:01:25.626895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:01:25.627004 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:01:25.627023 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:01:25.627038 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:01:25.627051 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:01:25.627066 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:01:25.627147 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:01:25.934203 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:01:28.005830 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:01:28.005926 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:01:28.005999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:01:28.006065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:01:28.006080 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:01:28.006096 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:01:28.006110 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:01:28.313499 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:01:55.159071 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:01:55.159106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:01:55.159122 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:01:55.159209 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:01:55.159226 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:01:55.159301 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:01:55.159366 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:01:55.470656 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:01:56.197183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:01:56.197215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:01:56.197276 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:01:56.197338 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:01:56.197355 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:01:56.197369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:01:56.197384 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:01:56.500426 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:02:25.730170 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:02:25.730283 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:02:25.730302 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:02:25.730318 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:02:25.730332 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:02:25.730347 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:02:25.730423 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:02:26.033773 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:02:26.757624 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:02:26.757654 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:02:26.757686 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:02:26.757700 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:02:26.757714 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:02:26.757790 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:02:26.757862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:02:27.068711 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:02:28.126183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:02:28.126220 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:02:28.126312 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:02:28.126369 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:02:28.126385 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:02:28.126401 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:02:28.126414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:02:28.438883 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:02:56.292467 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:02:56.292498 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:02:56.292512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:02:56.292597 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:02:56.292613 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:02:56.292700 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:02:56.292782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:02:56.599268 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:02:57.338338 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:02:57.338429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:02:57.338445 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:02:57.338459 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:02:57.338472 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:02:57.338534 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:02:57.338548 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:02:57.641180 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:03:26.860012 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:03:26.860045 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:03:26.860063 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:03:26.860157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:03:26.860173 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:03:26.860255 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:03:26.860329 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:03:27.163867 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:03:27.903615 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:03:27.903650 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:03:27.903753 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:03:27.903814 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:03:27.903831 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:03:27.903855 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:03:27.903880 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:03:28.214529 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:03:28.472573 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:03:28.472672 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:03:28.472738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:03:28.472803 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:03:28.472821 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:03:28.472836 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:03:28.472850 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:03:28.781329 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:03:57.426744 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:03:57.426842 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:03:57.426905 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:03:57.426983 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:03:57.426998 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:03:57.427014 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:03:57.427027 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:03:57.734628 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:03:58.474502 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:03:58.474556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:03:58.474758 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:03:58.474912 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:03:58.474938 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:03:58.474964 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:03:58.474987 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:03:58.782166 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:04:27.992103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:04:27.992135 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:04:27.992240 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:04:27.992254 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:04:27.992310 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:04:27.992379 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:04:27.992394 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:04:28.307198 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:04:28.570315 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:04:28.570429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:04:28.570449 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:04:28.570463 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:04:28.570479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:04:28.570549 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:04:28.570563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:04:28.873482 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:04:29.133798 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:04:29.133909 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:04:29.133986 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:04:29.134062 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:04:29.134079 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:04:29.134096 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:04:29.134111 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:04:29.449281 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:04:58.570914 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:04:58.570948 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:04:58.571035 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:04:58.571100 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:04:58.571170 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:04:58.571185 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:04:58.571200 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:04:58.875396 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:04:59.707430 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:04:59.707460 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:04:59.707477 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:04:59.707559 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:04:59.707574 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:04:59.707643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:04:59.707704 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:05:00.016525 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:05:28.493911 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:05:28.494011 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:05:28.494026 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:05:28.494042 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:05:28.494056 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:05:28.494070 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:05:28.494138 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:05:28.796744 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:05:29.143173 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:05:29.143275 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:05:29.143298 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:05:29.143313 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:05:29.143328 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:05:29.143346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:05:29.143432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:05:29.446355 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:05:30.293624 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:05:30.293657 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:05:30.293687 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:05:30.293786 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:05:30.293802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:05:30.293880 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:05:30.293953 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:05:30.598812 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:05:59.709030 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:05:59.709061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:05:59.709196 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:05:59.709214 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:05:59.709320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:05:59.709394 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:05:59.709412 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:06:00.010975 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:06:00.851939 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:06:00.851971 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:06:00.851987 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:06:00.852071 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:06:00.852086 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:06:00.852160 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:06:00.852226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:06:01.162139 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:06:28.613778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:06:28.613806 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:06:28.613821 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:06:28.613891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:06:28.613965 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:06:28.614026 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:06:28.614040 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:06:28.921333 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:06:30.280805 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:06:30.280836 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:06:30.280900 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:06:30.280976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:06:30.281003 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:06:30.281018 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:06:30.281031 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:06:30.585816 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:06:31.431330 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:06:31.431364 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:06:31.431384 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:06:31.431397 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:06:31.431432 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:06:31.431499 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:06:31.431569 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:06:31.734705 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:07:00.845760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:07:00.845795 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:07:00.845825 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:07:00.845839 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:07:00.845854 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:07:00.845935 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:07:00.846011 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:07:01.144806 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:07:02.003283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:07:02.003404 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:07:02.003423 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:07:02.003441 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:07:02.003456 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:07:02.003528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:07:02.003544 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:07:02.334108 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:07:28.729865 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:07:28.729893 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:07:28.729910 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:07:28.729923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:07:28.729938 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:07:28.730002 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:07:28.730064 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:07:29.056469 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:07:31.407482 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:07:31.407514 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:07:31.407527 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:07:31.407542 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:07:31.407554 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:07:31.407616 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:07:31.407675 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:07:31.715690 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:07:32.594454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:07:32.594488 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:07:32.594587 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:07:32.594663 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:07:32.594679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:07:32.594694 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:07:32.594708 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:07:32.891260 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:07:48.393478 E | op-osd: failed to update OSD deployment "rook-ceph-osd-15": progress deadline exceeded on deployment "rook-ceph-osd-15": gave up waiting for deployment "rook-ceph-osd-15" to update because "ProgressDeadlineExceeded" >2022-11-23 14:07:48.393502 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 8 of 24 OSDs have been updated >2022-11-23 14:07:49.487493 I | op-osd: OSD 16 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:07:49.493192 I | op-osd: updating OSD 16 on PVC "ocs-deviceset-2-data-2dtlkq" >2022-11-23 14:07:49.493224 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-2dtlkq" and its metadata device on "ocs-deviceset-2-metadata-2ngfs9" >2022-11-23 14:07:49.493248 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-2prbmt" >2022-11-23 14:07:49.493885 I | op-osd: assigning osd 16 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 14:07:50.660060 I | op-osd: OSD 17 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:07:50.664643 I | op-osd: updating OSD 17 on PVC "ocs-deviceset-2-data-39nfvc" >2022-11-23 14:07:50.664665 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-39nfvc" and its metadata device on "ocs-deviceset-2-metadata-324rgb" >2022-11-23 14:07:50.664668 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-3lwhts" >2022-11-23 14:07:50.664917 I | op-osd: assigning osd 17 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 14:07:51.790017 I | op-osd: OSD 18 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:07:51.794294 I | op-osd: updating OSD 18 on PVC "ocs-deviceset-2-data-65vppw" >2022-11-23 14:07:51.794320 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-65vppw" and its metadata device on "ocs-deviceset-2-metadata-6mlfv7" >2022-11-23 14:07:51.794323 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-6qtnqg" >2022-11-23 14:07:51.794528 I | op-osd: assigning osd 18 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 14:07:52.952819 I | op-osd: updating OSD 19 on PVC "ocs-deviceset-2-data-4qsl7c" >2022-11-23 14:07:52.952843 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-4qsl7c" and its metadata device on "ocs-deviceset-2-metadata-457pkl" >2022-11-23 14:07:52.952847 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-4q8dnm" >2022-11-23 14:07:52.953057 I | op-osd: assigning osd 19 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 14:08:01.997611 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:08:01.997643 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:08:01.997677 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:08:01.997690 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:08:01.997765 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:08:01.997834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:08:01.997898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:08:02.325071 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:08:03.148660 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:08:03.148690 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:08:03.148819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:08:03.148893 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:08:03.148969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:08:03.149053 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:08:03.149069 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:08:03.450637 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:08:28.847009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:08:28.847037 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:08:28.847052 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:08:28.847065 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:08:28.847131 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:08:28.847193 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:08:28.847262 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:08:29.156350 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:08:32.585747 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:08:32.585835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:08:32.585853 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:08:32.585870 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:08:32.585883 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:08:32.585945 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:08:32.586003 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:08:32.895217 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:08:33.711403 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:08:33.711437 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:08:33.711462 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:08:33.711477 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:08:33.711549 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:08:33.711618 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:08:33.711684 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:08:34.016782 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:09:03.158715 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:09:03.158813 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:09:03.158833 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:09:03.158853 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:09:03.158870 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:09:03.158947 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:09:03.159011 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:09:03.470657 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:09:04.288585 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:09:04.288707 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:09:04.288800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:09:04.288878 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:09:04.288895 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:09:04.288912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:09:04.288929 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:09:04.587729 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:09:28.965015 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:09:28.965095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:09:28.965164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:09:28.965226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:09:28.965242 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:09:28.965260 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:09:28.965275 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:09:29.299161 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:09:33.734070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:09:33.734163 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:09:33.734179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:09:33.734196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:09:33.734211 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:09:33.734269 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:09:33.734331 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:09:34.039545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:09:34.846247 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:09:34.846342 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:09:34.846362 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:09:34.846383 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:09:34.846400 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:09:34.846478 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:09:34.846555 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:09:35.154489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:10:04.304900 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:10:04.304957 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:10:04.305089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:10:04.305373 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:10:04.305879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:10:04.306646 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:10:04.306805 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:10:04.607633 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:10:05.416767 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:10:05.416880 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:10:05.416898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:10:05.416912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:10:05.416927 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:10:05.417020 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:10:05.417094 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:10:05.719812 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:10:29.082806 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:10:29.082924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:10:29.082949 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:10:29.082970 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:10:29.082988 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:10:29.083064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:10:29.083137 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:10:29.398138 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:10:34.871014 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:10:34.871055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:10:34.871133 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:10:34.871200 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:10:34.871261 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:10:34.871323 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:10:34.871339 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:10:35.174405 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:10:35.983385 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:10:35.983484 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:10:35.983575 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:10:35.983657 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:10:35.983676 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:10:35.983694 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:10:35.983735 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:10:36.285410 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:11:05.440078 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:11:05.440182 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:11:05.440261 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:11:05.440329 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:11:05.440402 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:11:05.440419 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:11:05.440434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:11:05.746107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:11:06.545979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:11:06.546056 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:11:06.546076 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:11:06.546089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:11:06.546105 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:11:06.546175 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:11:06.546235 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:11:06.850570 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:11:29.202036 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:11:29.202119 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:11:29.202209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:11:29.202287 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:11:29.202304 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:11:29.202322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:11:29.202339 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:11:29.507308 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:11:36.004273 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:11:36.004384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:11:36.004403 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:11:36.004418 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:11:36.004432 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:11:36.004521 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:11:36.004594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:11:36.308103 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:11:37.111373 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:11:37.111399 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:11:37.111412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:11:37.111509 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:11:37.111577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:11:37.111644 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:11:37.111711 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:11:37.418545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:12:06.568835 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:12:06.568946 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:12:06.568961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:12:06.568976 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:12:06.568990 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:12:06.569051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:12:06.569128 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:12:06.872906 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:12:07.681354 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:12:07.681488 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:12:07.681568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:12:07.681639 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:12:07.681713 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:12:07.681735 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:12:07.681751 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:12:07.983397 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:12:29.320822 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:12:29.320915 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:12:29.320930 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:12:29.320945 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:12:29.320958 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:12:29.321031 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:12:29.321112 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:12:29.622387 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:12:37.131302 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:12:37.131335 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:12:37.131350 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:12:37.131364 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:12:37.131434 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:12:37.131511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:12:37.131576 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:12:37.436585 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:12:38.247365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:12:38.247407 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:12:38.247440 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:12:38.247454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:12:38.247530 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:12:38.247594 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:12:38.247655 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:12:38.559150 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:13:07.696805 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:13:07.696834 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:13:07.696848 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:13:07.696925 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:13:07.696986 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:13:07.697044 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:13:07.697109 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:13:08.008467 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:13:08.819740 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:13:08.819770 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:13:08.819858 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:13:08.819934 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:13:08.819992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:13:08.820051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:13:08.820066 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:13:09.130198 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:13:29.437687 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:13:29.437787 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:13:29.437805 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:13:29.437820 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:13:29.437834 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:13:29.437897 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:13:29.437958 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:13:29.745037 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:13:38.276386 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:13:38.276420 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:13:38.276434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:13:38.276448 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:13:38.276512 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:13:38.276571 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:13:38.276634 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:13:38.583323 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:13:39.400736 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:13:39.400765 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:13:39.400781 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:13:39.400860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:13:39.400924 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:13:39.400989 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:13:39.401050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:13:39.708760 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:14:08.844579 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:14:08.844612 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:14:08.844704 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:14:08.844792 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:14:08.844883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:14:08.844954 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:14:08.844970 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:14:09.146425 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:14:09.972046 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:14:09.972075 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:14:09.972171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:14:09.972246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:14:09.972320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:14:09.972398 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:14:09.972414 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:14:10.301069 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:14:29.554620 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:14:29.554651 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:14:29.554667 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:14:29.554767 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:14:29.554843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:14:29.554907 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:14:29.554980 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:14:29.860969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:14:39.407551 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:14:39.407673 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:14:39.407743 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:14:39.407813 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:14:39.407831 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:14:39.407847 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:14:39.407862 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:14:39.711190 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:14:40.560973 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:14:40.561004 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:14:40.561038 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:14:40.561142 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:14:40.561215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:14:40.561311 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:14:40.561388 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:14:40.868840 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:15:09.975027 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:15:09.975143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:15:09.975228 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:15:09.975304 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:15:09.975388 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:15:09.975406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:15:09.975424 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:15:10.304561 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:15:11.134617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:15:11.134708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:15:11.134728 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:15:11.134763 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:15:11.134777 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:15:11.134850 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:15:11.134920 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:15:11.433784 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:15:29.682629 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:15:29.682735 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:15:29.682813 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:15:29.682884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:15:29.682955 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:15:29.682971 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:15:29.682988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:15:29.989648 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:15:40.561804 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:15:40.561839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:15:40.561855 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:15:40.561870 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:15:40.561949 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:15:40.562018 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:15:40.562088 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:15:40.867026 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:15:41.690857 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:15:41.690940 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:15:41.691002 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:15:41.691062 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:15:41.691079 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:15:41.691095 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:15:41.691109 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:15:42.013745 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:16:11.129912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:16:11.129948 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:16:11.130054 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:16:11.130137 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:16:11.130216 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:16:11.130283 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:16:11.130299 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:16:11.438688 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:16:12.298290 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:16:12.298323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:16:12.298339 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:16:12.298353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:16:12.298432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:16:12.298512 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:16:12.298578 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:16:12.599491 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:16:29.809256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:16:29.809283 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:16:29.809298 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:16:29.809381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:16:29.809447 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:16:29.809509 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:16:29.809575 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:16:30.124653 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:16:41.696930 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:16:41.697041 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:16:41.697056 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:16:41.697071 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:16:41.697086 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:16:41.697148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:16:41.697208 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:16:42.011117 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:16:42.857109 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:16:42.857140 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:16:42.857221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:16:42.857276 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:16:42.857352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:16:42.857408 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:16:42.857424 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:16:43.167409 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:17:12.294767 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:17:12.294868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:17:12.294940 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:17:12.295005 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:17:12.295075 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:17:12.295090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:17:12.295104 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:17:12.599223 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:17:13.440417 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:17:13.440454 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:17:13.440470 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:17:13.440484 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:17:13.440551 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:17:13.440639 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:17:13.440699 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:17:13.742450 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:17:29.934443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:17:29.934471 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:17:29.934551 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:17:29.934612 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:17:29.934686 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:17:29.934754 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:17:29.934770 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:17:30.258337 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:17:42.861823 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:17:42.861855 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:17:42.861869 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:17:42.861956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:17:42.862038 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:17:42.862099 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:17:42.862160 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:17:43.171352 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:17:44.010351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:17:44.010429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:17:44.010459 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:17:44.010473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:17:44.010485 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:17:44.010545 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:17:44.010607 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:17:44.311849 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:17:55.063114 E | op-osd: failed to update OSD deployment "rook-ceph-osd-19": progress deadline exceeded on deployment "rook-ceph-osd-19": gave up waiting for deployment "rook-ceph-osd-19" to update because "ProgressDeadlineExceeded" >2022-11-23 14:17:55.063139 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 12 of 24 OSDs have been updated >2022-11-23 14:17:56.158789 I | op-osd: OSD 2 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:17:56.163031 I | op-osd: updating OSD 2 on PVC "ocs-deviceset-0-data-5ks6wf" >2022-11-23 14:17:56.163047 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-5ks6wf" and its metadata device on "ocs-deviceset-0-metadata-5l7x2m" >2022-11-23 14:17:56.163051 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-57pv6z" >2022-11-23 14:17:56.163263 I | op-osd: assigning osd 2 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 14:17:57.298056 I | op-osd: OSD 20 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:17:57.302107 I | op-osd: updating OSD 20 on PVC "ocs-deviceset-2-data-56s2sg" >2022-11-23 14:17:57.302125 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-56s2sg" and its metadata device on "ocs-deviceset-2-metadata-5wczjg" >2022-11-23 14:17:57.302129 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-5s226m" >2022-11-23 14:17:57.302315 I | op-osd: assigning osd 20 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 14:17:58.420711 I | op-osd: OSD 21 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:17:58.425264 I | op-osd: updating OSD 21 on PVC "ocs-deviceset-1-data-7kf4tb" >2022-11-23 14:17:58.425280 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-7kf4tb" and its metadata device on "ocs-deviceset-1-metadata-7ll7pw" >2022-11-23 14:17:58.425283 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-79jmc9" >2022-11-23 14:17:58.425478 I | op-osd: assigning osd 21 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 14:17:59.549465 I | op-osd: OSD 22 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:17:59.554045 I | op-osd: updating OSD 22 on PVC "ocs-deviceset-0-data-7bznfx" >2022-11-23 14:17:59.554061 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-7bznfx" and its metadata device on "ocs-deviceset-0-metadata-7bdqfj" >2022-11-23 14:17:59.554064 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-7jps5n" >2022-11-23 14:17:59.554276 I | op-osd: assigning osd 22 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 14:18:00.691511 I | op-osd: OSD 23 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:18:00.695197 I | op-osd: updating OSD 23 on PVC "ocs-deviceset-2-data-72v4qp" >2022-11-23 14:18:00.695215 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-72v4qp" and its metadata device on "ocs-deviceset-2-metadata-7l8wjf" >2022-11-23 14:18:00.695220 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-7nf8xz" >2022-11-23 14:18:00.695404 I | op-osd: assigning osd 23 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 14:18:01.822925 I | op-osd: OSD 3 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:18:01.828359 I | op-osd: updating OSD 3 on PVC "ocs-deviceset-0-data-4bjtfw" >2022-11-23 14:18:01.828374 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-4bjtfw" and its metadata device on "ocs-deviceset-0-metadata-4fff89" >2022-11-23 14:18:01.828378 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-4xgsvz" >2022-11-23 14:18:01.828579 I | op-osd: assigning osd 3 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 14:18:02.986238 I | op-osd: updating OSD 4 on PVC "ocs-deviceset-0-data-1vd6t2" >2022-11-23 14:18:02.986258 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-1vd6t2" and its metadata device on "ocs-deviceset-0-metadata-1jdkcg" >2022-11-23 14:18:02.986261 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-1r6b2z" >2022-11-23 14:18:02.986464 I | op-osd: assigning osd 4 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 14:18:13.429391 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:18:13.429483 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:18:13.429545 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:18:13.429616 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:18:13.429682 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:18:13.429699 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:18:13.429712 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:18:13.730805 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:18:14.572189 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:18:14.572224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:18:14.572351 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:18:14.572441 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:18:14.572528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:18:14.572607 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:18:14.572678 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:18:14.872339 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:18:30.061399 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:18:30.061505 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:18:30.061591 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:18:30.061661 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:18:30.061735 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:18:30.061807 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:18:30.061825 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:18:30.382234 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:18:43.993887 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:18:43.993998 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:18:43.994061 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:18:43.994130 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:18:43.994147 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:18:43.994162 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:18:43.994223 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:18:44.316150 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:18:45.137189 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:18:45.137220 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:18:45.137235 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:18:45.137309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:18:45.137385 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:18:45.137467 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:18:45.137545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:18:45.441370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:19:14.581750 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:19:14.581830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:19:14.581901 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:19:14.581969 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:19:14.581987 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:19:14.582000 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:19:14.582077 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:19:14.887263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:19:15.710270 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:19:15.710382 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:19:15.710446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:19:15.710547 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:19:15.710611 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:19:15.710676 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:19:15.710693 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:19:16.017750 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:19:30.190843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:19:30.190939 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:19:30.191026 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:19:30.191098 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:19:30.191115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:19:30.191133 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:19:30.191210 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:19:30.495066 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:19:45.148607 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:19:45.148708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:19:45.148733 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:19:45.148753 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:19:45.148823 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:19:45.148904 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:19:45.148972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:19:45.452518 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:19:46.284416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:19:46.284504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:19:46.284519 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:19:46.284533 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:19:46.284581 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:19:46.284653 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:19:46.284720 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:19:46.588512 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:20:15.714794 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:20:15.714891 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:20:15.714910 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:20:15.714927 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:20:15.715008 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:20:15.715088 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:20:15.715153 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:20:16.016734 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:20:16.850974 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:20:16.851076 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:20:16.851143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:20:16.851215 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:20:16.851294 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:20:16.851309 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:20:16.851326 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:20:17.150473 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:20:30.325534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:20:30.325565 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:20:30.325658 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:20:30.325741 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:20:30.325817 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:20:30.325905 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:20:30.325985 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:20:30.627360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:20:46.272268 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:20:46.272360 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:20:46.272432 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:20:46.272513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:20:46.272529 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:20:46.272547 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:20:46.272627 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:20:46.574852 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:20:47.409887 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:20:47.409986 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:20:47.410003 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:20:47.410020 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:20:47.410087 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:20:47.410166 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:20:47.410237 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:20:47.711496 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:21:16.828109 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:21:16.828141 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:21:16.828174 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:21:16.828248 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:21:16.828330 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:21:16.828407 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:21:16.828485 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:21:17.133364 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:21:17.974809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:21:17.974928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:21:17.974947 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:21:17.974964 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:21:17.975040 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:21:17.975115 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:21:17.975187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:21:18.282082 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:21:30.452450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:21:30.452481 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:21:30.452514 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:21:30.452597 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:21:30.452669 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:21:30.452754 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:21:30.452838 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:21:30.750448 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:21:47.392430 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:21:47.392529 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:21:47.392546 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:21:47.392562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:21:47.392632 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:21:47.392707 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:21:47.392802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:21:47.698425 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:21:48.542221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:21:48.542307 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:21:48.542390 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:21:48.542467 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:21:48.542484 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:21:48.542499 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:21:48.542574 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:21:48.841870 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:22:17.972052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:22:17.972087 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:22:17.972119 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:22:17.972194 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:22:17.972272 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:22:17.972343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:22:17.972416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:22:18.274275 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:22:19.102034 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:22:19.102399 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:22:19.102603 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:22:19.103504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:22:19.103564 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:22:19.103587 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:22:19.103699 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:22:19.417151 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:22:30.578785 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:22:30.578873 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:22:30.578945 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:22:30.579015 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:22:30.579084 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:22:30.579102 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:22:30.579118 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:22:30.890317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:22:48.543814 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:22:48.543897 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:22:48.543977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:22:48.544048 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:22:48.544064 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:22:48.544082 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:22:48.544137 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:22:48.849272 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:22:49.676974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:22:49.677071 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:22:49.677141 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:22:49.677199 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:22:49.677261 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:22:49.677321 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:22:49.677338 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:22:49.989593 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:23:19.107691 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:23:19.107792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:23:19.107873 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:23:19.107934 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:23:19.107998 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:23:19.108065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:23:19.108081 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:23:19.426536 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:23:20.270729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:23:20.270841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:23:20.270918 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:23:20.270988 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:23:20.271073 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:23:20.271087 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:23:20.271109 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:23:20.572805 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:23:30.704463 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:23:30.704550 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:23:30.704568 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:23:30.704581 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:23:30.704647 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:23:30.704716 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:23:30.704793 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:23:31.016273 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:23:49.687556 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:23:49.687600 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:23:49.687632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:23:49.687707 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:23:49.687779 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:23:49.687842 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:23:49.687911 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:23:50.000516 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:23:50.829809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:23:50.829907 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:23:50.829928 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:23:50.829943 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:23:50.830004 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:23:50.830064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:23:50.830121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:23:51.134697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:24:20.272614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:24:20.272649 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:24:20.272752 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:24:20.272858 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:24:20.272930 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:24:20.273011 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:24:20.273090 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:24:20.579838 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:24:21.394737 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:24:21.394820 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:24:21.394837 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:24:21.394855 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:24:21.394933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:24:21.395010 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:24:21.395088 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:24:21.704542 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:24:30.828342 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:24:30.828464 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:24:30.828539 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:24:30.828610 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:24:30.828697 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:24:30.828775 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:24:30.828791 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:24:31.126523 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:24:50.841263 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:24:50.841348 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:24:50.841369 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:24:50.841384 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:24:50.841449 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:24:50.841513 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:24:50.841576 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:24:51.148409 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:24:51.970877 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:24:51.970959 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:24:51.971028 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:24:51.971097 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:24:51.971112 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:24:51.971130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:24:51.971200 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:24:52.310238 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:25:21.412724 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:25:21.412811 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:25:21.412878 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:25:21.412942 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:25:21.412959 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:25:21.412977 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:25:21.413035 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:25:21.720122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:25:22.579822 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:25:22.579926 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:25:22.579991 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:25:22.580069 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:25:22.580141 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:25:22.580157 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:25:22.580172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:25:22.876640 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:25:30.953868 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:25:30.953897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:25:30.953912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:25:30.953985 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:25:30.954051 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:25:30.954125 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:25:30.954192 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:25:31.268512 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:25:51.984212 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:25:51.984246 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:25:51.984260 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:25:51.984333 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:25:51.984393 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:25:51.984451 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:25:51.984514 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:25:52.315876 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:25:53.146215 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:25:53.146329 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:25:53.146403 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:25:53.146461 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:25:53.146518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:25:53.146532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:25:53.146546 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:25:53.449699 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:26:22.577326 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:26:22.577435 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:26:22.577454 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:26:22.577468 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:26:22.577554 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:26:22.577627 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:26:22.577700 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:26:22.878811 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:26:23.712070 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:26:23.712162 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:26:23.712234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:26:23.712307 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:26:23.712324 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:26:23.712337 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:26:23.712400 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:26:24.015379 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:26:31.078406 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:26:31.078497 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:26:31.078575 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:26:31.078643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:26:31.078732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:26:31.078750 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:26:31.078766 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:26:31.378188 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:26:53.138405 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:26:53.138491 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:26:53.138510 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:26:53.138525 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:26:53.138594 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:26:53.138663 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:26:53.138749 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:26:53.450190 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:26:54.281592 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:26:54.281678 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:26:54.281762 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:26:54.281828 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:26:54.281844 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:26:54.281860 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:26:54.281921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:26:54.589254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:27:23.714768 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:27:23.714811 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:27:23.714845 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:27:23.714911 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:27:23.714973 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:27:23.715034 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:27:23.715095 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:27:24.028783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:27:24.851752 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:27:24.851844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:27:24.851916 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:27:24.851980 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:27:24.851997 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:27:24.852015 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:27:24.852082 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:27:25.168916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:27:31.207910 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:27:31.207993 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:27:31.208070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:27:31.208141 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:27:31.208162 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:27:31.208181 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:27:31.208255 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:27:31.516332 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:27:54.301041 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:27:54.301071 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:27:54.301176 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:27:54.301259 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:27:54.301333 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:27:54.301403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:27:54.302650 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:27:54.605396 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:27:55.434431 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:27:55.434524 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:27:55.434604 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:27:55.434685 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:27:55.434704 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:27:55.434725 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:27:55.434800 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:27:55.750622 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:28:05.144295 E | op-osd: failed to update OSD deployment "rook-ceph-osd-4": progress deadline exceeded on deployment "rook-ceph-osd-4": gave up waiting for deployment "rook-ceph-osd-4" to update because "ProgressDeadlineExceeded" >2022-11-23 14:28:05.144322 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 19 of 24 OSDs have been updated >2022-11-23 14:28:06.244413 I | op-osd: OSD 5 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:28:06.249575 I | op-osd: updating OSD 5 on PVC "ocs-deviceset-1-data-0n9nmx" >2022-11-23 14:28:06.249593 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-0n9nmx" and its metadata device on "ocs-deviceset-1-metadata-0smm8c" >2022-11-23 14:28:06.249596 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-04hg6m" >2022-11-23 14:28:06.249821 I | op-osd: assigning osd 5 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 14:28:07.396497 I | op-osd: updating OSD 6 on PVC "ocs-deviceset-0-data-38bf6x" >2022-11-23 14:28:07.396519 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-38bf6x" and its metadata device on "ocs-deviceset-0-metadata-38nb58" >2022-11-23 14:28:07.396523 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-3tkdfd" >2022-11-23 14:28:07.396711 I | op-osd: assigning osd 6 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 14:28:24.866419 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:28:24.866525 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:28:24.866594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:28:24.866656 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:28:24.866727 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:28:24.866803 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:28:24.866865 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:28:25.181606 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:28:26.015166 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:28:26.015252 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:28:26.015269 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:28:26.015337 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:28:26.015403 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:28:26.015459 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:28:26.015522 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:28:26.322827 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:28:31.335758 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:28:31.335839 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:28:31.335910 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:28:31.335928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:28:31.335993 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:28:31.336053 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:28:31.336123 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:28:31.642755 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:28:55.450322 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:28:55.450407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:28:55.450490 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:28:55.450551 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:28:55.450614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:28:55.450628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:28:55.450686 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:28:55.758468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:28:56.589481 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:28:56.589564 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:28:56.589582 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:28:56.589644 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:28:56.589712 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:28:56.589773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:28:56.589832 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:28:56.899761 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:29:26.023226 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:29:26.023322 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:29:26.023424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:29:26.023504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:29:26.023577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:29:26.023595 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:29:26.023661 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:29:26.326064 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:29:27.159526 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:29:27.159619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:29:27.159700 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:29:27.159724 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:29:27.159799 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:29:27.159876 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:29:27.159956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:29:27.462771 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:29:31.463909 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:29:31.464020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:29:31.464092 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:29:31.464109 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:29:31.464176 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:29:31.464257 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:29:31.464325 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:29:31.762836 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:29:56.583758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:29:56.583791 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:29:56.583861 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:29:56.583925 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:29:56.583994 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:29:56.584060 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:29:56.584124 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:29:56.889811 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:29:57.717531 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:29:57.717608 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:29:57.717672 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:29:57.717745 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:29:57.717809 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:29:57.717871 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:29:57.717889 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:29:58.024459 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:30:27.153710 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:30:27.153816 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:30:27.153884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:30:27.153949 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:30:27.154010 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:30:27.154026 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:30:27.154094 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:30:27.470359 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:30:28.291118 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:30:28.291215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:30:28.291295 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:30:28.291355 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:30:28.291422 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:30:28.291441 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:30:28.291510 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:30:28.609374 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:30:31.589296 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:30:31.589384 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:30:31.589451 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:30:31.589511 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:30:31.589574 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:30:31.589636 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:30:31.589698 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:30:31.905962 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:30:57.733806 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:30:57.733903 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:30:57.733977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:30:57.734044 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:30:57.734108 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:30:57.734177 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:30:57.734239 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:30:58.037558 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:30:58.875546 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:30:58.875644 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:30:58.875664 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:30:58.875752 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:30:58.875830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:30:58.875911 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:30:58.875983 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:30:59.184528 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:31:28.299740 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:31:28.299851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:31:28.299868 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:31:28.299946 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:31:28.300027 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:31:28.300108 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:31:28.300188 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:31:28.600482 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:31:29.448173 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:31:29.448281 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:31:29.448352 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:31:29.448369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:31:29.448445 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:31:29.448512 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:31:29.448586 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:31:29.758907 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:31:31.713777 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:31:31.713810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:31:31.713881 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:31:31.713946 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:31:31.714008 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:31:31.714072 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:31:31.714134 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:31:32.037701 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:31:58.858526 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:31:58.858618 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:31:58.858679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:31:58.858696 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:31:58.858768 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:31:58.858845 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:31:58.858907 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:31:59.165923 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:32:00.022518 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:32:00.022600 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:32:00.022676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:32:00.022748 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:32:00.022809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:32:00.022826 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:32:00.022900 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:32:00.337047 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:32:29.427607 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:32:29.427695 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:32:29.427777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:32:29.427844 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:32:29.427913 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:32:29.427930 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:32:29.427989 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:32:29.732411 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:32:30.597549 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:32:30.597653 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:32:30.597715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:32:30.597792 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:32:30.597858 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:32:30.597929 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:32:30.597990 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:32:30.901581 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:32:31.838639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:32:31.838733 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:32:31.838816 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:32:31.838890 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:32:31.838967 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:32:31.838983 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:32:31.839054 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:32:32.164954 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:32:59.996609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:32:59.996715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:32:59.996782 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:32:59.996854 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:32:59.996923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:32:59.996989 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:32:59.997052 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:33:00.324732 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:33:01.160314 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:33:01.160425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:33:01.160490 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:33:01.160555 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:33:01.160617 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:33:01.160681 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:33:01.160696 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:33:01.475897 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:33:30.588762 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:33:30.588870 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:33:30.588889 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:33:30.588951 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:33:30.589010 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:33:30.589070 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:33:30.589128 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:33:30.895533 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:33:31.743514 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:33:31.743599 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:33:31.743665 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:33:31.744723 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:33:31.745160 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:33:31.745326 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:33:31.745985 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:33:32.070902 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:33:32.350764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:33:32.350865 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:33:32.350934 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:33:32.351007 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:33:32.351074 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:33:32.351143 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:33:32.351211 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:33:32.663866 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:34:01.161881 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:34:01.161984 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:34:01.162054 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:34:01.162072 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:34:01.162146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:34:01.162221 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:34:01.162313 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:34:01.466118 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:34:02.351744 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:34:02.351855 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:34:02.351938 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:34:02.351960 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:34:02.352030 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:34:02.352110 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:34:02.352184 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:34:02.650564 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:34:31.724957 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:34:31.725052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:34:31.725112 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:34:31.725130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:34:31.725196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:34:31.725258 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:34:31.725330 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:34:32.041941 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:34:32.310168 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:34:32.310241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:34:32.310309 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:34:32.310328 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:34:32.310387 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:34:32.310449 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:34:32.310510 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:34:32.618590 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:34:32.907414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:34:32.907492 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:34:32.907558 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:34:32.907617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:34:32.907677 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:34:32.907744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:34:32.907762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:34:33.220807 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:35:02.312090 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:35:02.312175 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:35:02.312243 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:35:02.312258 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:35:02.312323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:35:02.312381 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:35:02.312445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:35:02.620081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:35:03.497598 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:35:03.497647 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:35:03.497713 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:35:03.497785 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:35:03.497850 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:35:03.497913 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:35:03.497974 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:35:03.802101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:35:32.226513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:35:32.226596 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:35:32.226673 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:35:32.226744 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:35:32.226815 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:35:32.226834 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:35:32.226898 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:35:32.528814 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:35:32.895440 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:35:32.895528 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:35:32.895591 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:35:32.895610 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:35:32.895668 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:35:32.895731 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:35:32.895792 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:35:33.199906 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:35:34.064676 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:35:34.064771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:35:34.064843 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:35:34.064923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:35:34.064990 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:35:34.065067 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:35:34.065083 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:35:34.370384 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:36:03.465007 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:36:03.465106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:36:03.465190 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:36:03.465210 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:36:03.465284 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:36:03.465361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:36:03.465441 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:36:03.774896 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:36:04.627208 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:36:04.627240 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:36:04.627318 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:36:04.627395 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:36:04.627466 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:36:04.627546 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:36:04.627617 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:36:04.938082 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:36:32.356242 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:36:32.356369 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:36:32.356451 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:36:32.356527 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:36:32.356603 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:36:32.356673 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:36:32.356767 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:36:32.656016 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:36:34.033492 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:36:34.033599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:36:34.033623 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:36:34.033715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:36:34.033808 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:36:34.033890 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:36:34.033977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:36:34.357337 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:36:35.198762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:36:35.198875 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:36:35.198936 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:36:35.199006 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:36:35.199071 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:36:35.199089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:36:35.199157 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:36:35.512836 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:37:04.625992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:37:04.626098 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:37:04.626162 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:37:04.626191 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:37:04.626250 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:37:04.626310 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:37:04.626363 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:37:04.937956 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:37:05.769784 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:37:05.769863 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:37:05.769929 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:37:05.769991 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:37:05.770057 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:37:05.770074 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:37:05.770138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:37:06.071194 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:37:32.480894 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:37:32.480976 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:37:32.481049 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:37:32.481125 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:37:32.481190 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:37:32.481207 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:37:32.481269 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:37:32.795062 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:37:35.205199 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:37:35.205312 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:37:35.205391 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:37:35.205461 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:37:35.205537 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:37:35.205555 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:37:35.205630 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:37:35.504790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:37:36.329471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:37:36.329506 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:37:36.329592 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:37:36.329664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:37:36.329733 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:37:36.329804 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:37:36.329886 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:37:36.626259 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:38:05.762746 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:38:05.762832 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:38:05.762904 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:38:05.762975 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:38:05.763042 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:38:05.763058 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:38:05.763118 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:38:06.062381 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:38:06.883543 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:38:06.883576 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:38:06.883640 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:38:06.883708 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:38:06.883781 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:38:06.883851 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:38:06.883917 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:38:07.185219 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:38:09.513285 E | op-osd: failed to update OSD deployment "rook-ceph-osd-6": progress deadline exceeded on deployment "rook-ceph-osd-6": gave up waiting for deployment "rook-ceph-osd-6" to update because "ProgressDeadlineExceeded" >2022-11-23 14:38:09.513311 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 21 of 24 OSDs have been updated >2022-11-23 14:38:10.615264 I | op-osd: OSD 7 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:38:10.619243 I | op-osd: updating OSD 7 on PVC "ocs-deviceset-1-data-39vw7k" >2022-11-23 14:38:10.619259 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-39vw7k" and its metadata device on "ocs-deviceset-1-metadata-3b5jhh" >2022-11-23 14:38:10.619263 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-3rjmpt" >2022-11-23 14:38:10.619474 I | op-osd: assigning osd 7 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 14:38:11.761898 I | op-osd: updating OSD 8 on PVC "ocs-deviceset-0-data-6gm2pc" >2022-11-23 14:38:11.761926 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-6gm2pc" and its metadata device on "ocs-deviceset-0-metadata-6f4z9s" >2022-11-23 14:38:11.761929 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-65gnbk" >2022-11-23 14:38:11.762137 I | op-osd: assigning osd 8 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 14:38:32.609833 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:38:32.609937 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:38:32.610012 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:38:32.611079 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:38:32.611323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:38:32.611527 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:38:32.611957 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:38:32.911672 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:38:36.319799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:38:36.319903 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:38:36.319967 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:38:36.320032 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:38:36.320098 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:38:36.320163 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:38:36.320227 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:38:36.626738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:38:37.446050 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:38:37.446164 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:38:37.446236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:38:37.446314 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:38:37.446387 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:38:37.446462 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:38:37.446532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:38:37.748043 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:39:06.888448 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:39:06.888565 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:39:06.888654 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:39:06.888720 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:39:06.888805 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:39:06.888872 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:39:06.888955 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:39:07.198045 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:39:08.007658 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:39:08.007759 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:39:08.007845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:39:08.007927 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:39:08.008004 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:39:08.008096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:39:08.008182 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:39:08.313636 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:39:32.740003 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:39:32.740116 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:39:32.740197 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:39:32.740271 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:39:32.740349 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:39:32.740418 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:39:32.740508 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:39:33.040099 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:39:37.464815 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:39:37.464924 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:39:37.465015 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:39:37.465095 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:39:37.465166 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:39:37.465255 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:39:37.465331 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:39:37.765192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:39:38.573873 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:39:38.574417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:39:38.574786 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:39:38.575499 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:39:38.575598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:39:38.575683 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:39:38.575782 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:39:38.878566 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:40:08.021206 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:40:08.021285 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:40:08.021349 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:40:08.021415 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:40:08.021483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:40:08.021542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:40:08.021605 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:40:08.325281 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:40:09.138676 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:40:09.138792 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:40:09.138873 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:40:09.138947 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:40:09.139026 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:40:09.139098 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:40:09.139183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:40:09.444638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:40:32.867323 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:40:32.867429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:40:32.867513 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:40:32.867598 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:40:32.867673 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:40:32.867754 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:40:32.867830 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:40:33.173610 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:40:38.585410 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:40:38.585524 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:40:38.585601 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:40:38.585697 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:40:38.585771 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:40:38.585855 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:40:38.585929 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:40:38.888864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:40:39.711822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:40:39.711944 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:40:39.712029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:40:39.712100 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:40:39.712173 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:40:39.712258 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:40:39.712327 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:40:40.024200 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:41:09.143997 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:41:09.144097 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:41:09.144181 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:41:09.144263 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:41:09.144340 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:41:09.144415 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:41:09.144491 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:41:09.451937 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:41:10.301158 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:41:10.301248 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:41:10.301312 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:41:10.301382 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:41:10.301452 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:41:10.301526 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:41:10.301594 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:41:10.595925 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:41:32.994102 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:41:32.994183 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:41:32.994253 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:41:32.994321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:41:32.994388 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:41:32.994446 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:41:32.994507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:41:33.300319 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:41:39.720160 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:41:39.720278 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:41:39.720350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:41:39.720425 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:41:39.720504 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:41:39.720576 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:41:39.720647 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:41:40.032574 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:41:40.852579 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:41:40.852701 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:41:40.852772 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:41:40.852838 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:41:40.852908 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:41:40.852980 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:41:40.853042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:41:41.157077 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:42:10.308962 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:42:10.309067 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:42:10.309140 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:42:10.309228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:42:10.309315 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:42:10.309404 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:42:10.309481 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:42:10.606431 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:42:11.417994 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:42:11.418087 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:42:11.418167 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:42:11.418241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:42:11.418317 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:42:11.418387 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:42:11.418457 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:42:11.717510 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:42:33.125015 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:42:33.125099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:42:33.125185 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:42:33.125260 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:42:33.125332 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:42:33.125398 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:42:33.125472 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:42:33.436838 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:42:40.863474 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:42:40.863548 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:42:40.863624 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:42:40.863688 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:42:40.863764 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:42:40.863825 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:42:40.863881 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:42:41.178634 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:42:41.988142 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:42:41.988227 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:42:41.988290 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:42:41.988353 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:42:41.988422 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:42:41.988492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:42:41.988562 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:42:42.311104 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:43:11.444830 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:43:11.444924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:43:11.445007 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:43:11.445072 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:43:11.445142 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:43:11.445209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:43:11.445278 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:43:11.752991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:43:12.582738 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:43:12.582833 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:43:12.582896 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:43:12.582963 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:43:12.583022 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:43:12.583082 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:43:12.583144 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:43:12.888901 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:43:33.255068 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:43:33.255175 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:43:33.255276 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:43:33.255363 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:43:33.255448 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:43:33.255522 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:43:33.255595 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:43:33.557005 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:43:42.018167 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:43:42.018263 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:43:42.018336 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:43:42.018427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:43:42.018503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:43:42.018592 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:43:42.018669 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:43:42.348431 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:43:43.157272 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:43:43.157385 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:43:43.157483 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:43:43.157574 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:43:43.157655 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:43:43.157745 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:43:43.157836 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:43:43.454740 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:44:12.609024 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:44:12.609113 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:44:12.609184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:44:12.609254 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:44:12.609331 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:44:12.609396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:44:12.609465 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:44:12.920535 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:44:13.708258 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:44:13.708340 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:44:13.708409 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:44:13.708470 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:44:13.708539 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:44:13.708597 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:44:13.708665 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:44:14.014806 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:44:33.382232 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:44:33.382328 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:44:33.382396 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:44:33.382484 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:44:33.382554 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:44:33.382629 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:44:33.382711 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:44:33.683726 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:44:43.186963 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:44:43.187074 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:44:43.187148 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:44:43.187221 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:44:43.187285 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:44:43.187355 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:44:43.187412 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:44:43.496208 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:44:44.279565 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:44:44.279659 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:44:44.279725 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:44:44.279789 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:44:44.279852 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:44:44.279910 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 14:44:44.279971 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:44:44.590773 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:45:13.765162 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:45:13.765250 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:45:13.765321 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:45:13.765390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:45:13.765462 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:45:13.765477 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:45:13.765538 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:45:14.074342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:45:14.859134 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:45:14.859264 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:45:14.859335 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:45:14.859412 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:45:14.859483 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:45:14.859558 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:45:14.859630 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 14:45:15.164530 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:45:33.504284 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:45:33.505219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:45:33.505477 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:45:33.505690 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:45:33.506347 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:45:33.506776 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:45:33.506958 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:45:33.811775 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:45:44.344111 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:45:44.344202 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:45:44.344276 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:45:44.344345 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:45:44.344427 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:45:44.344447 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:45:44.344465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:45:44.654351 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:45:45.436384 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 14:45:45.436483 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 14:45:45.436501 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:45:45.436517 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:45:45.436580 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:45:45.436638 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:45:45.436701 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:45:45.744582 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:46:14.916306 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:46:14.916341 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:46:14.916358 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:46:14.916372 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:46:14.916386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:46:14.916458 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:46:14.916531 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:46:15.222928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:46:16.006004 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:46:16.006035 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:46:16.006051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:46:16.006064 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:46:16.006139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:46:16.006205 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 14:46:16.006266 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:46:16.310703 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:46:33.627374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:46:33.627404 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:46:33.627424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:46:33.627547 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:46:33.627577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:46:33.627651 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:46:33.627667 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:46:33.933769 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:46:45.492442 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:46:45.492473 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:46:45.492561 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:46:45.492575 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:46:45.492597 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:46:45.492609 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:46:45.492620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:46:45.795242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:46:46.567654 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:46:46.567685 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:46:46.567789 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 14:46:46.567807 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:46:46.567823 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:46:46.567838 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:46:46.567853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:46:46.874254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:47:16.050605 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:47:16.050636 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:47:16.050650 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:47:16.050664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:47:16.050675 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:47:16.050686 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:47:16.050700 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:47:16.364354 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:47:17.139443 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:47:17.139468 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:47:17.139501 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:47:17.139526 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:47:17.139541 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:47:17.139552 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:47:17.139565 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:47:17.440870 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:47:33.743320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:47:33.743346 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:47:33.743361 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:47:33.743376 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:47:33.743389 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:47:33.743402 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:47:33.743415 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:47:34.044101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:47:46.625169 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:47:46.625200 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:47:46.625231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:47:46.625245 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:47:46.625259 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:47:46.625281 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:47:46.625293 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:47:46.934601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:47:47.704630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:47:47.704664 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:47:47.704678 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:47:47.704694 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:47:47.704708 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:47:47.704730 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:47:47.704743 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:47:48.014624 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:48:17.203810 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:48:17.203843 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:48:17.203860 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:48:17.203875 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:48:17.203890 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:48:17.203905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:48:17.203919 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:48:17.520835 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:48:18.284948 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:48:18.284979 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:48:18.284995 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:48:18.285010 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:48:18.285024 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:48:18.285038 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:48:18.285054 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:48:18.595149 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:48:33.866589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:48:33.866617 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:48:33.866650 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:48:33.866664 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:48:33.866676 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:48:33.866691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:48:33.866703 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:48:34.173871 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:48:47.817345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:48:47.817374 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:48:47.817390 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:48:47.817403 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:48:47.817416 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:48:47.817428 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:48:47.817442 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:48:48.121593 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:48:48.857832 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:48:48.857856 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:48:48.857886 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:48:48.857900 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:48:48.857915 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:48:48.857936 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:48:48.857948 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:48:49.160368 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:49:18.388155 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:49:18.388184 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:49:18.388198 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:49:18.388219 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:49:18.388233 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:49:18.388246 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:49:18.388262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:49:18.688504 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:49:19.432803 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:49:19.432835 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:49:19.432852 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:49:19.432867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:49:19.432880 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:49:19.432894 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:49:19.432908 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:49:19.730696 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:49:33.990269 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:49:33.990299 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:49:33.990315 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:49:33.990328 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:49:33.990341 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:49:33.990361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:49:33.990374 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:49:34.301417 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:49:48.949793 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:49:48.949824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:49:48.949842 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:49:48.949857 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:49:48.949870 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:49:48.949885 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:49:48.949898 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:49:49.258758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:49:49.997153 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:49:49.997181 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:49:49.997215 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:49:49.997230 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:49:49.997243 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:49:49.997259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:49:49.997273 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:49:50.316073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:50:19.516911 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:50:19.516956 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:50:19.516988 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:50:19.516999 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:50:19.517015 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:50:19.517027 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:50:19.517041 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:50:19.824143 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:50:20.574284 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:50:20.574315 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:50:20.574330 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:50:20.574344 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:50:20.574358 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:50:20.574372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:50:20.574385 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:50:20.886620 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:50:34.121272 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:50:34.121300 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:50:34.121315 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:50:34.121330 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:50:34.121343 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:50:34.121356 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:50:34.121368 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:50:34.446959 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:50:50.095729 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:50:50.095762 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:50:50.095775 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:50:50.095789 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:50:50.095803 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:50:50.095816 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:50:50.095838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:50:50.411310 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:50:51.148987 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:50:51.149028 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:50:51.149074 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:50:51.149098 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:50:51.149299 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:50:51.149380 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:50:51.149418 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:50:51.453442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:51:20.670988 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:51:20.671017 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:51:20.671033 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:51:20.671062 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:51:20.671075 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:51:20.671090 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:51:20.671102 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:51:20.978109 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:51:21.710185 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:51:21.710207 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:51:21.710222 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:51:21.710235 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:51:21.710250 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:51:21.710280 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:51:21.710293 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:51:22.021696 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:51:34.248000 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:51:34.248030 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:51:34.248049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:51:34.248063 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:51:34.248076 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:51:34.248100 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:51:34.248114 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:51:34.554842 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:51:51.235303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:51:51.235337 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:51:51.235353 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:51:51.235366 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:51:51.235381 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:51:51.235395 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:51:51.235408 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:51:51.551309 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:51:52.289165 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:51:52.289199 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:51:52.289229 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:51:52.289243 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:51:52.289259 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:51:52.289274 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:51:52.289286 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:51:52.589820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:52:21.819349 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:52:21.819382 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:52:21.819412 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:52:21.819425 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:52:21.819440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:52:21.819452 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:52:21.819463 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:52:22.129589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:52:22.846128 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:52:22.846157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:52:22.846174 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:52:22.846189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:52:22.846201 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:52:22.846220 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:52:22.846244 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:52:23.149879 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:52:34.374341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:52:34.374366 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:52:34.374381 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:52:34.374393 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:52:34.374407 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:52:34.374420 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:52:34.374432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:52:34.676975 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:52:52.393574 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:52:52.393608 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:52:52.393623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:52:52.393636 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:52:52.393649 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:52:52.393666 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:52:52.393678 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:52:52.697154 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:52:53.413049 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:52:53.413077 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:52:53.413091 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:52:53.413104 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:52:53.413119 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:52:53.413133 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:52:53.413147 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:52:53.724204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:53:22.957390 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:53:22.957421 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:53:22.957437 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:53:22.957449 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:53:22.957464 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:53:22.957477 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:53:22.957488 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:53:23.274888 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:53:23.988041 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:53:23.988077 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:53:23.988092 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:53:23.988105 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:53:23.988117 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:53:23.988132 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:53:23.988144 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:53:24.311971 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:53:34.497403 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:53:34.497433 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:53:34.497449 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:53:34.497467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:53:34.497483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:53:34.497498 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:53:34.497516 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:53:34.798897 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:53:53.532818 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:53:53.532849 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:53:53.532864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:53:53.532877 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:53:53.532891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:53:53.532904 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:53:53.532924 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:53:53.830832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:53:54.575288 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:53:54.575319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:53:54.575336 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:53:54.575350 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:53:54.575363 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:53:54.575376 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:53:54.575391 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:53:54.875767 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:54:24.096304 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:54:24.096499 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:54:24.096569 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:54:24.096602 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:54:24.096648 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:54:24.096704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:54:24.097145 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:54:24.405155 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:54:25.146896 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:54:25.146926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:54:25.146941 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:54:25.146954 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:54:25.146967 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:54:25.146980 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:54:25.146993 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:54:25.449124 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:54:34.622114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:54:34.622142 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:54:34.622172 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:54:34.622185 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:54:34.622200 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:54:34.622212 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:54:34.622224 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:54:34.927822 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:54:54.658310 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:54:54.658343 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:54:54.658357 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:54:54.658371 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:54:54.658384 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:54:54.658396 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:54:54.658407 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:54:54.956223 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:54:55.711317 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:54:55.711381 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:54:55.711411 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:54:55.711440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:54:55.711463 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:54:55.711486 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:54:55.711510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:54:56.016821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:55:25.245553 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:55:25.245584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:55:25.245599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:55:25.245614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:55:25.245626 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:55:25.245637 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:55:25.245649 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:55:25.556588 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:55:26.280980 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:55:26.281007 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:55:26.281020 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:55:26.281034 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:55:26.281047 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:55:26.281058 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:55:26.281081 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:55:26.581532 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:55:34.749164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:55:34.749192 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:55:34.749229 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:55:34.749243 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:55:34.749268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:55:34.749282 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:55:34.749293 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:55:35.063036 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:55:55.815480 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:55:55.815511 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:55:55.815526 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:55:55.815542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:55:55.815555 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:55:55.815575 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:55:55.815586 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:55:56.124465 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:55:56.835535 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:55:56.835561 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:55:56.835575 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:55:56.835592 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:55:56.835605 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:55:56.835617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:55:56.835628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:55:57.139012 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:56:26.393859 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:56:26.393890 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:56:26.393905 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:56:26.393922 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:56:26.393935 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:56:26.393949 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:56:26.393960 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:56:26.691655 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:56:27.398754 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:56:27.398783 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:56:27.398798 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:56:27.398810 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:56:27.398823 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:56:27.398835 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:56:27.398847 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:56:27.707694 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:56:34.871746 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:56:34.871774 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:56:34.871789 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:56:34.871805 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:56:34.871818 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:56:34.871829 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:56:34.871840 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:56:35.178711 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:56:56.960671 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:56:56.960702 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:56:56.960722 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:56:56.960737 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:56:56.960750 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:56:56.960762 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:56:56.960775 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:56:57.267674 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:56:57.972662 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:56:57.972694 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:56:57.972714 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:56:57.972734 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:56:57.972750 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:56:57.972766 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:56:57.972793 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:56:58.286113 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:57:27.532415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:57:27.532446 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:57:27.532477 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:57:27.532495 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:57:27.532508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:57:27.532521 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:57:27.532532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:57:27.834495 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:57:28.556867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:57:28.556895 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:57:28.556925 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:57:28.556942 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:57:28.556956 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:57:28.556971 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:57:28.556983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:57:28.859635 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:57:35.000970 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:57:35.001001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:57:35.001017 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:57:35.001030 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:57:35.001042 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:57:35.001053 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:57:35.001065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:57:35.309169 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:57:58.101419 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:57:58.101449 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:57:58.101481 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:57:58.101494 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:57:58.101511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:57:58.101523 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:57:58.101537 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:57:58.403645 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:57:59.122025 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:57:59.122054 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:57:59.122068 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:57:59.122086 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:57:59.122099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:57:59.122112 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:57:59.122125 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:57:59.441852 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:58:11.817855 E | op-k8sutil: timed out waiting for deployments to be updated >2022-11-23 14:58:11.817908 E | op-osd: failed to update OSD deployment "rook-ceph-osd-8": timed out waiting on deployment "rook-ceph-osd-8" >2022-11-23 14:58:11.817919 I | op-osd: restarting watcher for OSD provisioning status ConfigMaps. the watcher closed the channel >2022-11-23 14:58:11.822291 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 23 of 24 OSDs have been updated >2022-11-23 14:58:12.922652 I | op-osd: OSD 9 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:58:12.927182 I | op-osd: updating OSD 9 on PVC "ocs-deviceset-1-data-1sjmbp" >2022-11-23 14:58:12.927200 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-1sjmbp" and its metadata device on "ocs-deviceset-1-metadata-1nkrbj" >2022-11-23 14:58:12.927204 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-14wj6w" >2022-11-23 14:58:12.927424 I | op-osd: assigning osd 9 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 14:58:12.983121 E | ceph-cluster-controller: failed to reconcile CephCluster "openshift-storage/ocs-storagecluster-cephcluster". failed to reconcile cluster "ocs-storagecluster-cephcluster": failed to configure local ceph cluster: failed to create cluster: failed to start ceph osds: 7 failures encountered while running osds on nodes in namespace "openshift-storage". >failed to update OSD deployment "rook-ceph-osd-11": progress deadline exceeded on deployment "rook-ceph-osd-11": gave up waiting for deployment "rook-ceph-osd-11" to update because "ProgressDeadlineExceeded" >failed to update OSD deployment "rook-ceph-osd-13": progress deadline exceeded on deployment "rook-ceph-osd-13": gave up waiting for deployment "rook-ceph-osd-13" to update because "ProgressDeadlineExceeded" >failed to update OSD deployment "rook-ceph-osd-15": progress deadline exceeded on deployment "rook-ceph-osd-15": gave up waiting for deployment "rook-ceph-osd-15" to update because "ProgressDeadlineExceeded" >failed to update OSD deployment "rook-ceph-osd-19": progress deadline exceeded on deployment "rook-ceph-osd-19": gave up waiting for deployment "rook-ceph-osd-19" to update because "ProgressDeadlineExceeded" >failed to update OSD deployment "rook-ceph-osd-4": progress deadline exceeded on deployment "rook-ceph-osd-4": gave up waiting for deployment "rook-ceph-osd-4" to update because "ProgressDeadlineExceeded" >failed to update OSD deployment "rook-ceph-osd-6": progress deadline exceeded on deployment "rook-ceph-osd-6": gave up waiting for deployment "rook-ceph-osd-6" to update because "ProgressDeadlineExceeded" >failed to update OSD deployment "rook-ceph-osd-8": timed out waiting on deployment "rook-ceph-osd-8" >2022-11-23 14:58:12.988786 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openshift-storage" >2022-11-23 14:58:12.993748 I | ceph-spec: parsing mon endpoints: b=172.30.188.21:6789,c=172.30.33.66:6789,a=172.30.219.163:6789 >2022-11-23 14:58:13.029582 I | ceph-spec: detecting the ceph image version for image registry.redhat.io/rhceph/rhceph-5-rhel8@sha256:7892e9da0a70b2d7e3efd98d2cb980e485f07eddff6a0dac6d6bd6c516914f3c... >2022-11-23 14:58:16.220449 I | ceph-spec: detected ceph image version: "16.2.8-84 pacific" >2022-11-23 14:58:16.220465 I | ceph-cluster-controller: validating ceph version from provided image >2022-11-23 14:58:16.224592 I | ceph-spec: parsing mon endpoints: b=172.30.188.21:6789,c=172.30.33.66:6789,a=172.30.219.163:6789 >2022-11-23 14:58:16.226661 I | cephclient: writing config file /var/lib/rook/openshift-storage/openshift-storage.config >2022-11-23 14:58:16.226761 I | cephclient: generated admin config in /var/lib/rook/openshift-storage >2022-11-23 14:58:16.527993 I | ceph-cluster-controller: cluster "openshift-storage": version "16.2.8-84 pacific" detected for image "registry.redhat.io/rhceph/rhceph-5-rhel8@sha256:7892e9da0a70b2d7e3efd98d2cb980e485f07eddff6a0dac6d6bd6c516914f3c" >2022-11-23 14:58:16.583990 I | op-mon: start running mons >2022-11-23 14:58:16.587655 I | ceph-spec: parsing mon endpoints: b=172.30.188.21:6789,c=172.30.33.66:6789,a=172.30.219.163:6789 >2022-11-23 14:58:16.811122 I | op-mon: saved mon endpoints to config map map[csi-cluster-config-json:[{"clusterID":"openshift-storage","monitors":["172.30.188.21:6789","172.30.33.66:6789","172.30.219.163:6789"],"namespace":""}] data:b=172.30.188.21:6789,c=172.30.33.66:6789,a=172.30.219.163:6789 mapping:{"node":{"a":null,"b":null,"c":null}} maxMonId:2] >2022-11-23 14:58:17.410901 I | cephclient: writing config file /var/lib/rook/openshift-storage/openshift-storage.config >2022-11-23 14:58:17.410997 I | cephclient: generated admin config in /var/lib/rook/openshift-storage >2022-11-23 14:58:19.011353 I | op-mon: targeting the mon count 3 >2022-11-23 14:58:19.021285 I | op-config: setting "global"="mon allow pool delete"="true" option to the mon configuration database >2022-11-23 14:58:19.284131 I | op-config: successfully set "global"="mon allow pool delete"="true" option to the mon configuration database >2022-11-23 14:58:19.284149 I | op-config: setting "global"="mon cluster log file"="" option to the mon configuration database >2022-11-23 14:58:19.533450 I | op-config: successfully set "global"="mon cluster log file"="" option to the mon configuration database >2022-11-23 14:58:19.533465 I | op-config: setting "global"="mon allow pool size one"="true" option to the mon configuration database >2022-11-23 14:58:19.783294 I | op-config: successfully set "global"="mon allow pool size one"="true" option to the mon configuration database >2022-11-23 14:58:19.783323 I | op-config: setting "global"="osd scrub auto repair"="true" option to the mon configuration database >2022-11-23 14:58:20.039818 I | op-config: successfully set "global"="osd scrub auto repair"="true" option to the mon configuration database >2022-11-23 14:58:20.039836 I | op-config: setting "global"="log to file"="true" option to the mon configuration database >2022-11-23 14:58:20.308809 I | op-config: successfully set "global"="log to file"="true" option to the mon configuration database >2022-11-23 14:58:20.308824 I | op-config: deleting "log file" option from the mon configuration database >2022-11-23 14:58:20.554253 I | op-config: successfully deleted "log file" option from the mon configuration database >2022-11-23 14:58:20.554267 I | op-mon: checking for basic quorum with existing mons >2022-11-23 14:58:20.577337 I | op-mon: mon "b" ip is 172.30.188.21 >2022-11-23 14:58:20.611661 I | op-mon: mon "c" ip is 172.30.33.66 >2022-11-23 14:58:21.411609 I | op-mon: mon "a" ip is 172.30.219.163 >2022-11-23 14:58:22.010489 I | op-mon: saved mon endpoints to config map map[csi-cluster-config-json:[{"clusterID":"openshift-storage","monitors":["172.30.188.21:6789","172.30.33.66:6789","172.30.219.163:6789"],"namespace":""}] data:b=172.30.188.21:6789,c=172.30.33.66:6789,a=172.30.219.163:6789 mapping:{"node":{"a":null,"b":null,"c":null}} maxMonId:2] >2022-11-23 14:58:22.610779 I | cephclient: writing config file /var/lib/rook/openshift-storage/openshift-storage.config >2022-11-23 14:58:22.610889 I | cephclient: generated admin config in /var/lib/rook/openshift-storage >2022-11-23 14:58:23.210475 I | op-mon: deployment for mon rook-ceph-mon-b already exists. updating if needed >2022-11-23 14:58:23.216888 I | op-k8sutil: deployment "rook-ceph-mon-b" did not change, nothing to update >2022-11-23 14:58:23.216907 I | op-mon: waiting for mon quorum with [b c a] >2022-11-23 14:58:23.821776 I | op-mon: mons running: [b c a] >2022-11-23 14:58:24.138943 I | op-mon: Monitors in quorum: [a b c] >2022-11-23 14:58:24.146804 I | op-mon: deployment for mon rook-ceph-mon-c already exists. updating if needed >2022-11-23 14:58:24.152898 I | op-k8sutil: deployment "rook-ceph-mon-c" did not change, nothing to update >2022-11-23 14:58:24.152919 I | op-mon: waiting for mon quorum with [b c a] >2022-11-23 14:58:24.619551 I | op-mon: mons running: [b c a] >2022-11-23 14:58:24.927763 I | op-mon: Monitors in quorum: [a b c] >2022-11-23 14:58:24.933939 I | op-mon: deployment for mon rook-ceph-mon-a already exists. updating if needed >2022-11-23 14:58:24.943362 I | op-k8sutil: deployment "rook-ceph-mon-a" did not change, nothing to update >2022-11-23 14:58:24.943380 I | op-mon: waiting for mon quorum with [b c a] >2022-11-23 14:58:25.419553 I | op-mon: mons running: [b c a] >2022-11-23 14:58:25.722710 I | op-mon: Monitors in quorum: [a b c] >2022-11-23 14:58:25.722737 I | op-mon: mons created: 3 >2022-11-23 14:58:26.030209 I | op-mon: waiting for mon quorum with [b c a] >2022-11-23 14:58:26.065770 I | op-mon: mons running: [b c a] >2022-11-23 14:58:26.367352 I | op-mon: Monitors in quorum: [a b c] >2022-11-23 14:58:26.368167 I | op-mon: checking for orphaned mon resources >2022-11-23 14:58:26.710559 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner" >2022-11-23 14:58:27.018845 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node" >2022-11-23 14:58:27.335936 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner" >2022-11-23 14:58:27.642663 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node" >2022-11-23 14:58:27.970186 I | ceph-csi: created kubernetes csi secrets for cluster "openshift-storage" >2022-11-23 14:58:27.970206 I | cephclient: getting or creating ceph auth key "client.crash" >2022-11-23 14:58:28.294007 I | ceph-crashcollector-controller: created kubernetes crash collector secret for cluster "openshift-storage" >2022-11-23 14:58:28.294040 I | op-config: deleting "mon_mds_skip_sanity" option from the mon configuration database >2022-11-23 14:58:28.550002 I | op-config: successfully deleted "mon_mds_skip_sanity" option from the mon configuration database >2022-11-23 14:58:28.550039 I | cephclient: create rbd-mirror bootstrap peer token "client.rbd-mirror-peer" >2022-11-23 14:58:28.550048 I | cephclient: getting or creating ceph auth key "client.rbd-mirror-peer" >2022-11-23 14:58:28.664848 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:58:28.664876 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:58:28.664893 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:58:28.664908 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:58:28.664923 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:58:28.664938 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:58:28.664952 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:58:28.868165 I | cephclient: successfully created rbd-mirror bootstrap peer token for cluster "ocs-storagecluster-cephcluster" >2022-11-23 14:58:28.892284 I | op-mgr: start running mgr >2022-11-23 14:58:28.892297 I | cephclient: getting or creating ceph auth key "mgr.a" >2022-11-23 14:58:28.978387 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:58:29.250636 I | op-mgr: deployment for mgr rook-ceph-mgr-a already exists. updating if needed >2022-11-23 14:58:29.257231 I | op-k8sutil: deployment "rook-ceph-mgr-a" did not change, nothing to update >2022-11-23 14:58:29.260452 I | op-mgr: setting services to point to mgr "a" >2022-11-23 14:58:29.697902 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:58:29.697928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:58:29.697945 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:58:29.697958 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:58:29.697973 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:58:29.697985 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:58:29.697997 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:58:30.001626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >W1123 14:58:30.012184 1 client_config.go:617] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work. >2022-11-23 14:58:30.210562 I | op-mgr: no need to update service "rook-ceph-mgr" >2022-11-23 14:58:30.210604 I | op-mgr: successful modules: balancer >2022-11-23 14:58:30.229030 I | op-osd: start running osds in namespace "openshift-storage" >2022-11-23 14:58:30.229043 I | op-osd: wait timeout for healthy OSDs during upgrade or restart is "10m0s" >2022-11-23 14:58:30.282352 I | op-osd: start provisioning the OSDs on PVCs, if needed >2022-11-23 14:58:30.416911 I | op-osd: verifying PVCs exist for 8 OSDs in device set "ocs-deviceset-0" >2022-11-23 14:58:30.416929 I | op-osd: OSD PVC "ocs-deviceset-0-data-6gm2pc" already exists >2022-11-23 14:58:30.416936 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-6f4z9s" already exists >2022-11-23 14:58:30.416939 I | op-osd: OSD PVC "ocs-deviceset-0-wal-65gnbk" already exists >2022-11-23 14:58:30.416943 I | op-osd: OSD PVC "ocs-deviceset-0-data-7bznfx" already exists >2022-11-23 14:58:30.416947 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-7bdqfj" already exists >2022-11-23 14:58:30.416951 I | op-osd: OSD PVC "ocs-deviceset-0-wal-7jps5n" already exists >2022-11-23 14:58:30.416955 I | op-osd: OSD PVC "ocs-deviceset-0-data-0bwms5" already exists >2022-11-23 14:58:30.416959 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-05l52j" already exists >2022-11-23 14:58:30.416963 I | op-osd: OSD PVC "ocs-deviceset-0-wal-0fpxq2" already exists >2022-11-23 14:58:30.416967 I | op-osd: OSD PVC "ocs-deviceset-0-data-1vd6t2" already exists >2022-11-23 14:58:30.416971 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-1jdkcg" already exists >2022-11-23 14:58:30.416975 I | op-osd: OSD PVC "ocs-deviceset-0-wal-1r6b2z" already exists >2022-11-23 14:58:30.416978 I | op-osd: OSD PVC "ocs-deviceset-0-data-2fgc98" already exists >2022-11-23 14:58:30.416982 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-2ljqb5" already exists >2022-11-23 14:58:30.416985 I | op-osd: OSD PVC "ocs-deviceset-0-wal-2fmx88" already exists >2022-11-23 14:58:30.416995 I | op-osd: OSD PVC "ocs-deviceset-0-data-38bf6x" already exists >2022-11-23 14:58:30.416998 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-38nb58" already exists >2022-11-23 14:58:30.417002 I | op-osd: OSD PVC "ocs-deviceset-0-wal-3tkdfd" already exists >2022-11-23 14:58:30.417006 I | op-osd: OSD PVC "ocs-deviceset-0-data-4bjtfw" already exists >2022-11-23 14:58:30.417009 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-4fff89" already exists >2022-11-23 14:58:30.417013 I | op-osd: OSD PVC "ocs-deviceset-0-wal-4xgsvz" already exists >2022-11-23 14:58:30.417018 I | op-osd: OSD PVC "ocs-deviceset-0-data-5ks6wf" already exists >2022-11-23 14:58:30.417022 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-5l7x2m" already exists >2022-11-23 14:58:30.417025 I | op-osd: OSD PVC "ocs-deviceset-0-wal-57pv6z" already exists >2022-11-23 14:58:30.417028 I | op-osd: verifying PVCs exist for 8 OSDs in device set "ocs-deviceset-1" >2022-11-23 14:58:30.417032 I | op-osd: OSD PVC "ocs-deviceset-1-data-6jjq7d" already exists >2022-11-23 14:58:30.417035 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-6w4wgm" already exists >2022-11-23 14:58:30.417039 I | op-osd: OSD PVC "ocs-deviceset-1-wal-62dgpw" already exists >2022-11-23 14:58:30.417044 I | op-osd: OSD PVC "ocs-deviceset-1-data-7kf4tb" already exists >2022-11-23 14:58:30.417048 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-7ll7pw" already exists >2022-11-23 14:58:30.417051 I | op-osd: OSD PVC "ocs-deviceset-1-wal-79jmc9" already exists >2022-11-23 14:58:30.417054 I | op-osd: OSD PVC "ocs-deviceset-1-data-0n9nmx" already exists >2022-11-23 14:58:30.417058 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-0smm8c" already exists >2022-11-23 14:58:30.417061 I | op-osd: OSD PVC "ocs-deviceset-1-wal-04hg6m" already exists >2022-11-23 14:58:30.417064 I | op-osd: OSD PVC "ocs-deviceset-1-data-1sjmbp" already exists >2022-11-23 14:58:30.417067 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-1nkrbj" already exists >2022-11-23 14:58:30.417071 I | op-osd: OSD PVC "ocs-deviceset-1-wal-14wj6w" already exists >2022-11-23 14:58:30.417074 I | op-osd: OSD PVC "ocs-deviceset-1-data-2kmplq" already exists >2022-11-23 14:58:30.417078 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-2qrzpr" already exists >2022-11-23 14:58:30.417082 I | op-osd: OSD PVC "ocs-deviceset-1-wal-25mhp6" already exists >2022-11-23 14:58:30.417086 I | op-osd: OSD PVC "ocs-deviceset-1-data-39vw7k" already exists >2022-11-23 14:58:30.417089 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-3b5jhh" already exists >2022-11-23 14:58:30.417093 I | op-osd: OSD PVC "ocs-deviceset-1-wal-3rjmpt" already exists >2022-11-23 14:58:30.417096 I | op-osd: OSD PVC "ocs-deviceset-1-data-4bcv2q" already exists >2022-11-23 14:58:30.417099 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-4hl2gm" already exists >2022-11-23 14:58:30.417103 I | op-osd: OSD PVC "ocs-deviceset-1-wal-4jzx9d" already exists >2022-11-23 14:58:30.417106 I | op-osd: OSD PVC "ocs-deviceset-1-data-5fg2rq" already exists >2022-11-23 14:58:30.417109 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-5mvm8w" already exists >2022-11-23 14:58:30.417112 I | op-osd: OSD PVC "ocs-deviceset-1-wal-5cwqh9" already exists >2022-11-23 14:58:30.417115 I | op-osd: verifying PVCs exist for 8 OSDs in device set "ocs-deviceset-2" >2022-11-23 14:58:30.417118 I | op-osd: OSD PVC "ocs-deviceset-2-data-56s2sg" already exists >2022-11-23 14:58:30.417122 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-5wczjg" already exists >2022-11-23 14:58:30.417125 I | op-osd: OSD PVC "ocs-deviceset-2-wal-5s226m" already exists >2022-11-23 14:58:30.417128 I | op-osd: OSD PVC "ocs-deviceset-2-data-65vppw" already exists >2022-11-23 14:58:30.417132 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-6mlfv7" already exists >2022-11-23 14:58:30.417135 I | op-osd: OSD PVC "ocs-deviceset-2-wal-6qtnqg" already exists >2022-11-23 14:58:30.417138 I | op-osd: OSD PVC "ocs-deviceset-2-data-72v4qp" already exists >2022-11-23 14:58:30.417143 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-7l8wjf" already exists >2022-11-23 14:58:30.417146 I | op-osd: OSD PVC "ocs-deviceset-2-wal-7nf8xz" already exists >2022-11-23 14:58:30.417153 I | op-osd: OSD PVC "ocs-deviceset-2-data-0dt89f" already exists >2022-11-23 14:58:30.417157 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-0ghkfb" already exists >2022-11-23 14:58:30.417160 I | op-osd: OSD PVC "ocs-deviceset-2-wal-0m6ldf" already exists >2022-11-23 14:58:30.417163 I | op-osd: OSD PVC "ocs-deviceset-2-data-1sg95c" already exists >2022-11-23 14:58:30.417167 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-1fdt8m" already exists >2022-11-23 14:58:30.417170 I | op-osd: OSD PVC "ocs-deviceset-2-wal-1qgp84" already exists >2022-11-23 14:58:30.417173 I | op-osd: OSD PVC "ocs-deviceset-2-data-2dtlkq" already exists >2022-11-23 14:58:30.417176 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-2ngfs9" already exists >2022-11-23 14:58:30.417180 I | op-osd: OSD PVC "ocs-deviceset-2-wal-2prbmt" already exists >2022-11-23 14:58:30.417183 I | op-osd: OSD PVC "ocs-deviceset-2-data-39nfvc" already exists >2022-11-23 14:58:30.417186 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-324rgb" already exists >2022-11-23 14:58:30.417189 I | op-osd: OSD PVC "ocs-deviceset-2-wal-3lwhts" already exists >2022-11-23 14:58:30.417193 I | op-osd: OSD PVC "ocs-deviceset-2-data-4qsl7c" already exists >2022-11-23 14:58:30.417196 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-457pkl" already exists >2022-11-23 14:58:30.417199 I | op-osd: OSD PVC "ocs-deviceset-2-wal-4q8dnm" already exists >2022-11-23 14:58:30.486839 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-6gm2pc" and its metadata device on "ocs-deviceset-0-metadata-6f4z9s" >2022-11-23 14:58:30.486860 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-65gnbk" >2022-11-23 14:58:30.486866 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-6gm2pc" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.486872 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-7bznfx" and its metadata device on "ocs-deviceset-0-metadata-7bdqfj" >2022-11-23 14:58:30.486876 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-7jps5n" >2022-11-23 14:58:30.486880 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-7bznfx" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.486885 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-0bwms5" and its metadata device on "ocs-deviceset-0-metadata-05l52j" >2022-11-23 14:58:30.486889 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-0fpxq2" >2022-11-23 14:58:30.486893 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-0bwms5" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.486897 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-1vd6t2" and its metadata device on "ocs-deviceset-0-metadata-1jdkcg" >2022-11-23 14:58:30.486901 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-1r6b2z" >2022-11-23 14:58:30.486905 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-1vd6t2" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.486909 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-2fgc98" and its metadata device on "ocs-deviceset-0-metadata-2ljqb5" >2022-11-23 14:58:30.486913 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-2fmx88" >2022-11-23 14:58:30.486916 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-2fgc98" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.486921 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-38bf6x" and its metadata device on "ocs-deviceset-0-metadata-38nb58" >2022-11-23 14:58:30.486925 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-3tkdfd" >2022-11-23 14:58:30.486929 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-38bf6x" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.486933 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-4bjtfw" and its metadata device on "ocs-deviceset-0-metadata-4fff89" >2022-11-23 14:58:30.486936 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-4xgsvz" >2022-11-23 14:58:30.486940 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-4bjtfw" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.486944 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-5ks6wf" and its metadata device on "ocs-deviceset-0-metadata-5l7x2m" >2022-11-23 14:58:30.486947 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-57pv6z" >2022-11-23 14:58:30.486950 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-5ks6wf" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.486955 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-6jjq7d" and its metadata device on "ocs-deviceset-1-metadata-6w4wgm" >2022-11-23 14:58:30.486958 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-62dgpw" >2022-11-23 14:58:30.486962 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-6jjq7d" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.486966 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-7kf4tb" and its metadata device on "ocs-deviceset-1-metadata-7ll7pw" >2022-11-23 14:58:30.486969 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-79jmc9" >2022-11-23 14:58:30.486973 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-7kf4tb" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.486978 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-0n9nmx" and its metadata device on "ocs-deviceset-1-metadata-0smm8c" >2022-11-23 14:58:30.486982 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-04hg6m" >2022-11-23 14:58:30.486985 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-0n9nmx" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.486990 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-1sjmbp" and its metadata device on "ocs-deviceset-1-metadata-1nkrbj" >2022-11-23 14:58:30.486993 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-14wj6w" >2022-11-23 14:58:30.486997 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-1sjmbp" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487001 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-2kmplq" and its metadata device on "ocs-deviceset-1-metadata-2qrzpr" >2022-11-23 14:58:30.487005 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-25mhp6" >2022-11-23 14:58:30.487009 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-2kmplq" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487013 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-39vw7k" and its metadata device on "ocs-deviceset-1-metadata-3b5jhh" >2022-11-23 14:58:30.487017 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-3rjmpt" >2022-11-23 14:58:30.487021 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-39vw7k" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487025 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-4bcv2q" and its metadata device on "ocs-deviceset-1-metadata-4hl2gm" >2022-11-23 14:58:30.487029 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-4jzx9d" >2022-11-23 14:58:30.487033 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-4bcv2q" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487037 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-5fg2rq" and its metadata device on "ocs-deviceset-1-metadata-5mvm8w" >2022-11-23 14:58:30.487041 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-5cwqh9" >2022-11-23 14:58:30.487045 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-5fg2rq" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487050 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-56s2sg" and its metadata device on "ocs-deviceset-2-metadata-5wczjg" >2022-11-23 14:58:30.487053 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-5s226m" >2022-11-23 14:58:30.487057 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-56s2sg" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487062 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-65vppw" and its metadata device on "ocs-deviceset-2-metadata-6mlfv7" >2022-11-23 14:58:30.487066 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-6qtnqg" >2022-11-23 14:58:30.487070 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-65vppw" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487074 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-72v4qp" and its metadata device on "ocs-deviceset-2-metadata-7l8wjf" >2022-11-23 14:58:30.487077 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-7nf8xz" >2022-11-23 14:58:30.487081 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-72v4qp" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487085 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-0dt89f" and its metadata device on "ocs-deviceset-2-metadata-0ghkfb" >2022-11-23 14:58:30.487088 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-0m6ldf" >2022-11-23 14:58:30.487092 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-0dt89f" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487096 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-1sg95c" and its metadata device on "ocs-deviceset-2-metadata-1fdt8m" >2022-11-23 14:58:30.487100 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-1qgp84" >2022-11-23 14:58:30.487103 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-1sg95c" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487107 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-2dtlkq" and its metadata device on "ocs-deviceset-2-metadata-2ngfs9" >2022-11-23 14:58:30.487110 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-2prbmt" >2022-11-23 14:58:30.487113 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-2dtlkq" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487117 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-39nfvc" and its metadata device on "ocs-deviceset-2-metadata-324rgb" >2022-11-23 14:58:30.487121 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-3lwhts" >2022-11-23 14:58:30.487124 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-39nfvc" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487128 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-4qsl7c" and its metadata device on "ocs-deviceset-2-metadata-457pkl" >2022-11-23 14:58:30.487132 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-4q8dnm" >2022-11-23 14:58:30.487135 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-4qsl7c" because OSD daemon using the PVC already exists >2022-11-23 14:58:30.487139 I | op-osd: start provisioning the OSDs on nodes, if needed >2022-11-23 14:58:30.487142 I | op-osd: no nodes are defined for configuring OSDs on raw devices >2022-11-23 14:58:31.507012 I | op-mgr: successful modules: prometheus >2022-11-23 14:58:31.507219 I | op-mgr: successful modules: dashboard >2022-11-23 14:58:31.507261 I | op-config: setting "global"="osd_pool_default_pg_autoscale_mode"="on" option to the mon configuration database >2022-11-23 14:58:31.703111 I | op-osd: OSD 0 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:58:31.708388 I | op-osd: updating OSD 0 on PVC "ocs-deviceset-0-data-0bwms5" >2022-11-23 14:58:31.708406 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-0bwms5" and its metadata device on "ocs-deviceset-0-metadata-05l52j" >2022-11-23 14:58:31.708410 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-0fpxq2" >2022-11-23 14:58:31.708655 I | op-osd: assigning osd 0 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 14:58:31.760444 I | op-config: successfully set "global"="osd_pool_default_pg_autoscale_mode"="on" option to the mon configuration database >2022-11-23 14:58:31.760459 I | op-config: setting "global"="mon_pg_warn_min_per_osd"="0" option to the mon configuration database >2022-11-23 14:58:32.023921 I | op-config: successfully set "global"="mon_pg_warn_min_per_osd"="0" option to the mon configuration database >2022-11-23 14:58:32.857115 I | op-osd: OSD 1 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:58:32.862640 I | op-osd: updating OSD 1 on PVC "ocs-deviceset-0-data-2fgc98" >2022-11-23 14:58:32.862656 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-2fgc98" and its metadata device on "ocs-deviceset-0-metadata-2ljqb5" >2022-11-23 14:58:32.862659 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-2fmx88" >2022-11-23 14:58:32.862893 I | op-osd: assigning osd 1 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 14:58:32.993915 I | op-mgr: successful modules: mgr module(s) from the spec >2022-11-23 14:58:33.990179 I | op-osd: OSD 10 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 14:58:33.995146 I | op-osd: updating OSD 10 on PVC "ocs-deviceset-1-data-4bcv2q" >2022-11-23 14:58:33.995161 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-4bcv2q" and its metadata device on "ocs-deviceset-1-metadata-4hl2gm" >2022-11-23 14:58:33.995164 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-4jzx9d" >2022-11-23 14:58:33.995367 I | op-osd: assigning osd 10 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 14:58:35.122303 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:58:35.122335 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:58:35.122348 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:58:35.122361 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:58:35.122375 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down and a possible node drain is detected >2022-11-23 14:58:35.122387 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:58:35.122399 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:58:35.150399 I | op-osd: updating OSD 11 on PVC "ocs-deviceset-1-data-2kmplq" >2022-11-23 14:58:35.150419 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-2kmplq" and its metadata device on "ocs-deviceset-1-metadata-2qrzpr" >2022-11-23 14:58:35.150424 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-25mhp6" >2022-11-23 14:58:35.150635 I | op-osd: assigning osd 11 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 14:58:35.437861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:58:59.251854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:58:59.251918 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:58:59.252040 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:58:59.252110 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:58:59.252135 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:58:59.252156 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:58:59.252539 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:58:59.564361 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:59:00.279418 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:59:00.279504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:59:00.279534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:59:00.279548 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:59:00.279563 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:59:00.279577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:59:00.279591 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:59:00.583064 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:59:29.823488 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:59:29.823520 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:59:29.823534 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:59:29.823629 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:59:29.823651 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:59:29.823667 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:59:29.823680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:59:30.138904 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:59:30.839415 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:59:30.839445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:59:30.839457 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:59:30.839547 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:59:30.839559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:59:30.839572 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:59:30.839588 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:59:31.143149 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 14:59:35.247368 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 14:59:35.247408 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 14:59:35.247427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 14:59:35.247441 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 14:59:35.247454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 14:59:35.247467 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 14:59:35.247483 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 14:59:35.552347 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:00:00.399625 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:00:00.399670 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:00:00.399684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:00:00.399697 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:00:00.399798 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:00:00.399813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:00:00.399828 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:00:00.714633 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:00:01.413466 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:00:01.413498 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:00:01.413516 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:00:01.413530 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:00:01.413542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:00:01.413554 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:00:01.413667 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:00:01.721429 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:00:30.971699 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:00:30.971746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:00:30.971761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:00:30.971775 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:00:30.971789 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:00:30.971877 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:00:30.971893 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:00:31.272433 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:00:31.991192 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:00:31.991305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:00:31.991323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:00:31.991337 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:00:31.991351 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:00:31.991367 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:00:31.991392 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:00:32.327743 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:00:35.371854 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:00:35.371946 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:00:35.371963 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:00:35.371977 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:00:35.371989 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:00:35.372007 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:00:35.372020 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:00:35.686560 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:01:01.539178 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:01:01.539209 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:01:01.539222 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:01:01.539311 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:01:01.539325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:01:01.539341 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:01:01.539354 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:01:01.852224 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:01:02.592547 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:01:02.592577 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:01:02.592591 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:01:02.592606 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:01:02.592620 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:01:02.592632 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:01:02.592715 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:01:02.904740 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:01:32.114990 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:01:32.115025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:01:32.115046 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:01:32.115158 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:01:32.115178 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:01:32.115201 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:01:32.115217 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:01:32.431380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:01:33.163221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:01:33.163251 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:01:33.163266 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:01:33.163355 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:01:33.163369 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:01:33.163383 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:01:33.163396 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:01:33.466224 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:01:35.496808 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:01:35.496974 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:01:35.497537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:01:35.497566 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:01:35.497585 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:01:35.497602 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:01:35.497618 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:01:35.798131 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:02:02.691547 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:02:02.691600 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:02:02.691632 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:02:02.691646 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:02:02.691663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:02:02.691676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:02:02.691763 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:02:02.998413 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:02:03.724804 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:02:03.724833 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:02:03.724863 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:02:03.724876 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:02:03.724892 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:02:03.724990 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:02:03.725005 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:02:04.030801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:02:33.262959 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:02:33.263006 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:02:33.263021 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:02:33.263035 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:02:33.263132 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:02:33.263157 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:02:33.263171 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:02:33.570834 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:02:34.298007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:02:34.298037 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:02:34.298052 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:02:34.298069 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:02:34.298157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:02:34.298174 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:02:34.298190 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:02:34.599906 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:02:35.617812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:02:35.617838 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:02:35.617855 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:02:35.617950 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:02:35.617964 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:02:35.617983 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:02:35.617997 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:02:35.916781 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:03:03.832940 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:03:03.833062 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:03:03.833081 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:03:03.833096 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:03:03.833112 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:03:03.833125 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:03:03.833139 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:03:04.137712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:03:04.863638 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:03:04.863669 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:03:04.863683 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:03:04.863777 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:03:04.863792 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:03:04.863806 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:03:04.863821 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:03:05.174776 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:03:34.406405 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:03:34.406446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:03:34.406460 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:03:34.406472 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:03:34.406569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:03:34.406586 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:03:34.406599 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:03:34.712638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:03:35.435710 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:03:35.435756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:03:35.435770 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:03:35.435850 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:03:35.435867 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:03:35.435883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:03:35.435898 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:03:35.739273 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:03:36.001879 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:03:36.001924 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:03:36.001957 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:03:36.001980 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:03:36.002000 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:03:36.002029 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:03:36.002585 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:03:36.306288 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:04:04.975560 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:04:04.975602 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:04:04.975617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:04:04.975695 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:04:04.975709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:04:04.975727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:04:04.975742 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:04:05.279796 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:04:06.001635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:04:06.001670 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:04:06.001689 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:04:06.001707 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:04:06.001731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:04:06.001818 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:04:06.001840 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:04:06.300131 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:04:35.543591 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:04:35.543694 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:04:35.543713 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:04:35.543732 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:04:35.543747 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:04:35.543763 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:04:35.543776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:04:35.856354 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:04:36.118830 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:04:36.118862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:04:36.118891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:04:36.118906 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:04:36.118918 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:04:36.118931 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:04:36.119017 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:04:36.432127 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:04:36.693387 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:04:36.693419 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:04:36.693449 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:04:36.693462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:04:36.693478 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:04:36.693491 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:04:36.693504 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:04:36.997215 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:05:06.120883 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:05:06.120913 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:05:06.120929 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:05:06.120942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:05:06.120956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:05:06.120972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:05:06.120984 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:05:06.428363 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:05:07.256418 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:05:07.256527 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:05:07.256545 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:05:07.256559 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:05:07.256573 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:05:07.256589 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:05:07.256603 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:05:07.573558 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:05:35.989886 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:05:35.989916 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:05:35.989929 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:05:35.990002 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:05:35.990024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:05:35.990040 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:05:35.990053 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:05:36.299870 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:05:36.686182 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:05:36.686213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:05:36.686246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:05:36.686259 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:05:36.686349 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:05:36.686366 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:05:36.686380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:05:36.997930 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:05:37.830361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:05:37.830393 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:05:37.830410 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:05:37.831198 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:05:37.831322 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:05:37.831358 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:05:37.831378 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:05:38.135948 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:06:07.260476 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:06:07.260510 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:06:07.260525 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:06:07.260539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:06:07.260629 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:06:07.260645 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:06:07.260661 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:06:07.569203 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:06:08.397522 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:06:08.397553 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:06:08.397584 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:06:08.397601 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:06:08.397698 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:06:08.397715 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:06:08.397735 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:06:08.699358 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:06:36.119426 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:06:36.119453 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:06:36.119472 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:06:36.119564 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:06:36.119581 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:06:36.119597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:06:36.119612 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:06:36.422848 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:06:37.833065 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:06:37.833099 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:06:37.833116 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:06:37.833206 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:06:37.833222 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:06:37.833238 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:06:37.833252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:06:38.138659 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:06:38.953578 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:06:38.953613 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:06:38.953627 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:06:38.953641 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:06:38.953654 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:06:38.953769 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:06:38.953786 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:06:39.258384 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:07:08.395013 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:07:08.395043 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:07:08.395059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:07:08.395073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:07:08.395087 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:07:08.395177 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:07:08.395192 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:07:08.695119 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:07:09.515375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:07:09.515404 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:07:09.515421 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:07:09.515436 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:07:09.515450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:07:09.515553 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:07:09.515569 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:07:09.825591 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:07:36.248848 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:07:36.248874 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:07:36.248887 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:07:36.248983 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:07:36.248999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:07:36.249015 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:07:36.249028 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:07:36.549652 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:07:38.964130 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:07:38.964155 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:07:38.964171 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:07:38.964185 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:07:38.964278 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:07:38.964296 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:07:38.964310 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:07:39.276468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:07:40.111454 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:07:40.111483 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:07:40.111502 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:07:40.111516 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:07:40.111531 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:07:40.111629 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:07:40.111646 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:07:40.424847 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:08:09.534515 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:08:09.534545 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:08:09.534561 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:08:09.534580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:08:09.534593 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:08:09.534697 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:08:09.534723 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:08:09.835368 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:08:10.687510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:08:10.687632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:08:10.687649 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:08:10.687663 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:08:10.687677 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:08:10.687694 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:08:10.687708 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:08:10.988059 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:08:36.376248 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:08:36.376279 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:08:36.376295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:08:36.376311 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:08:36.376325 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:08:36.376347 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:08:36.376437 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:08:36.682636 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:08:40.099825 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:08:40.099858 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:08:40.099872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:08:40.099886 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:08:40.099901 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:08:40.099914 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:08:40.100013 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:08:40.405036 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:08:41.252028 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:08:41.252063 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:08:41.252077 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:08:41.252174 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:08:41.252192 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:08:41.252207 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:08:41.252221 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:08:41.563302 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:09:10.664443 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:09:10.664486 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:09:10.664515 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:09:10.664528 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:09:10.664617 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:09:10.664633 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:09:10.664647 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:09:10.972713 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:09:11.826220 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:09:11.826252 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:09:11.826267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:09:11.826354 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:09:11.826369 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:09:11.826384 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:09:11.826398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:09:12.138328 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:09:36.499772 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:09:36.499800 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:09:36.499816 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:09:36.499829 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:09:36.499910 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:09:36.499926 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:09:36.499941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:09:36.812136 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:09:41.231311 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:09:41.231344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:09:41.231358 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:09:41.231371 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:09:41.231384 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:09:41.231395 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:09:41.231484 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:09:41.536428 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:09:42.408110 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:09:42.408210 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:09:42.408226 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:09:42.408241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:09:42.408255 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:09:42.408269 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:09:42.408283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:09:42.718331 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:10:11.800713 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:10:11.800827 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:10:11.800844 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:10:11.800862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:10:11.800877 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:10:11.800891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:10:11.800905 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:10:12.133306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:10:12.979430 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:10:12.979462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:10:12.979477 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:10:12.979490 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:10:12.979505 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:10:12.979587 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:10:12.979602 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:10:13.283018 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:10:36.626448 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:10:36.626561 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:10:36.626580 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:10:36.626594 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:10:36.626609 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:10:36.626625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:10:36.626639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:10:36.937200 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:10:42.399838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:10:42.399869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:10:42.399883 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:10:42.399898 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:10:42.399909 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:10:42.399921 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:10:42.400014 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:10:42.700231 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:10:43.545680 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:10:43.545714 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:10:43.545736 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:10:43.545750 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:10:43.545763 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:10:43.545863 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:10:43.545878 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:10:43.848962 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:11:12.961593 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:11:12.961726 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:11:12.961744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:11:12.961760 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:11:12.961775 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:11:12.961789 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:11:12.961804 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:11:13.264613 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:11:14.116039 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:11:14.116144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:11:14.116178 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:11:14.116193 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:11:14.116207 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:11:14.116220 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:11:14.116237 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:11:14.442627 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:11:36.751855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:11:36.751884 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:11:36.751914 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:11:36.752005 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:11:36.752023 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:11:36.752038 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:11:36.752051 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:11:37.058230 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:11:43.528409 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:11:43.528440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:11:43.528472 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:11:43.528486 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:11:43.528498 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:11:43.528609 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:11:43.528624 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:11:43.828860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:11:44.709389 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:11:44.709421 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:11:44.709435 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:11:44.709448 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:11:44.709461 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:11:44.709558 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:11:44.709573 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:11:45.014541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:12:14.089286 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:12:14.089411 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:12:14.089428 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:12:14.089443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:12:14.089456 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:12:14.089471 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:12:14.089484 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:12:14.394961 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:12:15.274854 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:12:15.274985 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:12:15.275006 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:12:15.275025 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:12:15.275045 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:12:15.275074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:12:15.275118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:12:15.585220 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:12:36.877512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:12:36.877540 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:12:36.877564 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:12:36.877578 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:12:36.877664 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:12:36.877687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:12:36.877701 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:12:37.188402 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:12:44.656518 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:12:44.656559 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:12:44.656576 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:12:44.656588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:12:44.656674 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:12:44.656692 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:12:44.656705 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:12:44.962454 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:12:45.848807 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:12:45.848836 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:12:45.848852 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:12:45.848932 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:12:45.848948 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:12:45.848963 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:12:45.848975 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:12:46.152438 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:13:15.221923 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:13:15.221955 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:13:15.221971 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:13:15.222055 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:13:15.222069 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:13:15.222083 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:13:15.222098 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:13:15.531534 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:13:16.407116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:13:16.407153 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:13:16.407167 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:13:16.407275 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:13:16.407290 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:13:16.407303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:13:16.407318 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:13:16.711306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:13:37.003467 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:13:37.003563 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:13:37.003581 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:13:37.003595 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:13:37.003612 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:13:37.003625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:13:37.003638 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:13:37.312785 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:13:45.791828 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:13:45.791873 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:13:45.791888 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:13:45.791971 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:13:45.791987 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:13:45.792002 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:13:45.792017 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:13:46.097830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:13:46.969539 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:13:46.969568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:13:46.969598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:13:46.969681 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:13:46.969696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:13:46.969711 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:13:46.969729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:13:47.272433 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:14:16.364218 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:14:16.364252 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:14:16.364265 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:14:16.364277 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:14:16.364290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:14:16.364303 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:14:16.364380 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:14:16.667543 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 15:14:17.546081 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:14:17.546171 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:14:17.546199 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:14:17.546458 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:14:17.546494 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:14:17.546550 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:14:17.546573 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:14:17.856214 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 15:14:37.125289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:14:37.125319 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:14:37.125335 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:14:37.125349 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:14:37.125363 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:14:37.125443 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:14:37.125459 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:14:37.429088 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 15:14:46.926506 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:14:46.926604 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:14:46.926619 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:14:46.926637 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:14:46.926650 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:14:46.926665 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:14:46.926681 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:14:47.239462 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:14:48.111172 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:14:48.111206 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:14:48.111222 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:14:48.111235 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:14:48.111247 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:14:48.111259 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:14:48.111352 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:14:48.417711 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:15:17.497765 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:15:17.497795 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:15:17.497810 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:15:17.497928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:15:17.497946 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:15:17.497963 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:15:17.497977 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:15:17.815097 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:15:18.682618 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:15:18.682744 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:15:18.682761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:15:18.682776 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:15:18.682790 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:15:18.682804 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:15:18.682833 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:15:18.996145 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:15:37.252284 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:15:37.252317 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:15:37.252332 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:15:37.252347 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:15:37.252361 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:15:37.252386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:15:37.252485 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:15:37.555477 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:15:48.077212 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:15:48.077241 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:15:48.077257 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:15:48.077348 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:15:48.077365 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:15:48.077381 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:15:48.077396 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:15:48.382907 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:15:49.266234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:15:49.266266 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:15:49.266300 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:15:49.266315 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:15:49.266327 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:15:49.266340 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:15:49.266355 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:15:49.572495 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:16:18.645804 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:16:18.645834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:16:18.645849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:16:18.645938 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:16:18.645955 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:16:18.645969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:16:18.645983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:16:18.960244 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:16:19.834951 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:16:19.835078 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:16:19.835104 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:16:19.835122 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:16:19.835141 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:16:19.835161 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:16:19.835179 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:16:20.155498 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:16:37.380176 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:16:37.380204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:16:37.380220 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:16:37.380233 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:16:37.380313 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:16:37.380330 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:16:37.380345 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:16:37.684890 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:16:49.237686 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:16:49.237722 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:16:49.237739 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:16:49.237751 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:16:49.237835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:16:49.237854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:16:49.237868 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:16:49.543795 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:16:50.425867 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:16:50.425898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:16:50.425917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:16:50.425929 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:16:50.425942 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:16:50.425954 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:16:50.425967 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:16:50.727745 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:17:19.809973 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:17:19.810089 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:17:19.810108 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:17:19.810121 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:17:19.810138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:17:19.810153 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:17:19.810167 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:17:20.128015 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:17:20.986716 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:17:20.986751 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:17:20.986782 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:17:20.986866 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:17:20.986881 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:17:20.986896 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:17:20.986910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:17:21.294568 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:17:37.512552 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:17:37.512579 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:17:37.512610 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:17:37.512713 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:17:37.512733 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:17:37.512749 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:17:37.512766 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:17:37.811622 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:17:50.386341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:17:50.386473 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:17:50.386491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:17:50.386510 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:17:50.386525 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:17:50.386542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:17:50.386556 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:17:50.688053 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:17:51.557942 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:17:51.558043 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:17:51.558060 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:17:51.558077 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:17:51.558091 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:17:51.558106 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:17:51.558119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:17:51.867162 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:18:20.948420 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:18:20.948449 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:18:20.948465 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:18:20.948482 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:18:20.948578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:18:20.948595 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:18:20.948609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:18:21.258795 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:18:22.140447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:18:22.140482 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:18:22.140497 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:18:22.140511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:18:22.140525 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down and a possible node drain is detected >2022-11-23 15:18:22.140621 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:18:22.140637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:18:22.443119 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:18:35.207081 E | op-k8sutil: timed out waiting for deployments to be updated >2022-11-23 15:18:35.207133 E | op-osd: failed to update OSD deployment "rook-ceph-osd-11": timed out waiting on deployment "rook-ceph-osd-11" >2022-11-23 15:18:35.207145 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 4 of 24 OSDs have been updated >2022-11-23 15:18:36.313253 I | op-osd: OSD 12 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 15:18:36.317828 I | op-osd: updating OSD 12 on PVC "ocs-deviceset-1-data-6jjq7d" >2022-11-23 15:18:36.317846 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-6jjq7d" and its metadata device on "ocs-deviceset-1-metadata-6w4wgm" >2022-11-23 15:18:36.317849 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-62dgpw" >2022-11-23 15:18:36.318073 I | op-osd: assigning osd 12 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 15:18:37.467517 I | op-osd: updating OSD 13 on PVC "ocs-deviceset-1-data-5fg2rq" >2022-11-23 15:18:37.467540 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-5fg2rq" and its metadata device on "ocs-deviceset-1-metadata-5mvm8w" >2022-11-23 15:18:37.467544 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-5cwqh9" >2022-11-23 15:18:37.467729 I | op-osd: assigning osd 13 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 15:18:37.637638 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:18:37.637728 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:18:37.637746 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:18:37.637762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:18:37.637782 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:18:37.637796 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:18:37.637809 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:18:37.940800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:18:51.515739 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:18:51.515772 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:18:51.515803 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:18:51.515895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:18:51.515968 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:18:51.515983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:18:51.516001 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:18:51.824313 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:18:52.703950 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:18:52.703979 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:18:52.704091 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:18:52.704162 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:18:52.704178 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:18:52.704193 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:18:52.704206 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:18:53.012710 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:19:22.096607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:19:22.096642 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:19:22.096662 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:19:22.096677 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:19:22.096793 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:19:22.096878 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:19:22.096899 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:19:22.405904 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:19:23.273001 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:19:23.273032 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:19:23.273050 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:19:23.273064 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:19:23.273081 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:19:23.273097 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:19:23.273169 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:19:23.579111 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:19:37.768129 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:19:37.768156 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:19:37.768187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:19:37.768203 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:19:37.768295 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:19:37.768376 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:19:37.768393 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:19:38.078083 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:19:52.666451 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:19:52.666542 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:19:52.666564 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:19:52.666580 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:19:52.666593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:19:52.666609 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:19:52.666623 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:19:52.969774 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:19:53.847502 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:19:53.847535 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:19:53.847623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:19:53.847715 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:19:53.847739 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:19:53.847752 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:19:53.847768 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:19:54.151992 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:20:23.238327 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:20:23.238361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:20:23.238375 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:20:23.238478 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:20:23.238564 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:20:23.238581 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:20:23.238597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:20:23.542836 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:20:24.412800 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:20:24.412835 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:20:24.412867 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:20:24.412982 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:20:24.413059 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:20:24.413074 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:20:24.413089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:20:24.714783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:20:37.900430 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:20:37.900525 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:20:37.900541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:20:37.900556 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:20:37.900568 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:20:37.900586 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:20:37.900601 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:20:38.201649 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:20:53.804023 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:20:53.804054 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:20:53.804145 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:20:53.804221 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:20:53.804237 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:20:53.804253 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:20:53.804266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:20:54.112108 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:20:54.972428 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:20:54.973738 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:20:54.973801 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:20:54.973834 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:20:54.973860 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:20:54.973887 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:20:54.973915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:20:55.286898 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:21:24.383290 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:21:24.383320 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:21:24.383416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:21:24.383499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:21:24.383517 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:21:24.383533 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:21:24.383548 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:21:24.685639 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:21:25.547527 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:21:25.547642 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:21:25.547661 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:21:25.547675 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:21:25.547689 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:21:25.547705 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:21:25.547722 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:21:25.846993 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:21:38.031064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:21:38.031095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:21:38.031188 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:21:38.031262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:21:38.031282 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:21:38.031297 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:21:38.031313 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:21:38.332783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:21:54.943412 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:21:54.943443 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:21:54.943474 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:21:54.943488 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:21:54.943567 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:21:54.943631 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:21:54.943647 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:21:55.264472 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:21:56.111211 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:21:56.111239 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:21:56.111271 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:21:56.111285 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:21:56.111381 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:21:56.111460 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:21:56.111479 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:21:56.416369 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:22:25.534844 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:22:25.534875 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:22:25.534970 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:22:25.535043 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:22:25.535059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:22:25.535075 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:22:25.535089 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:22:25.839638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:22:26.673130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:22:26.673154 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:22:26.673171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:22:26.673185 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:22:26.673285 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:22:26.673354 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:22:26.673369 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:22:26.983951 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:22:38.159513 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:22:38.159598 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:22:38.159614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:22:38.159634 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:22:38.159648 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:22:38.159663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:22:38.159675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:22:38.462417 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:22:56.098774 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:22:56.098808 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:22:56.098826 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:22:56.098840 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:22:56.098857 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:22:56.098875 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:22:56.098966 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:22:56.406817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:22:57.246351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:22:57.246479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:22:57.246500 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:22:57.246516 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:22:57.246561 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:22:57.246577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:22:57.246592 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:22:57.548960 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:23:26.662565 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:23:26.662675 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:23:26.662694 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:23:26.662709 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:23:26.662729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:23:26.662746 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:23:26.662771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:23:26.971062 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:23:27.807710 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:23:27.807811 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:23:27.807828 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:23:27.807845 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:23:27.807861 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:23:27.807875 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:23:27.807889 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:23:28.111989 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:23:38.291141 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:23:38.291171 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:23:38.291186 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:23:38.291277 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:23:38.291353 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:23:38.291370 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:23:38.291384 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:23:38.607494 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:23:57.229005 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:23:57.229037 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:23:57.229163 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:23:57.229229 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:23:57.229244 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:23:57.229260 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:23:57.229273 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:23:57.534876 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:23:58.371165 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:23:58.371196 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:23:58.371285 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:23:58.371361 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:23:58.371378 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:23:58.371394 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:23:58.371408 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:23:58.678374 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:24:27.796352 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:24:27.796386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:24:27.796417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:24:27.796432 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:24:27.796446 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:24:27.796542 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:24:27.796619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:24:28.100695 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:24:28.947437 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:24:28.947470 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:24:28.947566 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:24:28.947633 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:24:28.947650 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:24:28.947664 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:24:28.947678 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:24:29.261117 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:24:38.420709 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:24:38.420739 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:24:38.420773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:24:38.420787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:24:38.420872 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:24:38.420952 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:24:38.420968 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:24:38.721476 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:24:58.374217 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:24:58.374327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:24:58.374348 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:24:58.374364 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:24:58.374380 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:24:58.374396 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:24:58.374411 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:24:58.681334 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:24:59.520413 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:24:59.520448 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:24:59.520464 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:24:59.520496 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:24:59.520518 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:24:59.520538 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:24:59.520623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:24:59.843132 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:25:28.953260 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:25:28.953291 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:25:28.953376 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:25:28.953442 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:25:28.953458 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:25:28.953475 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:25:28.953489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:25:29.272345 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:25:30.114184 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:25:30.114215 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:25:30.114311 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:25:30.114399 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:25:30.114417 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:25:30.114928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:25:30.115097 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:25:30.417425 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:25:38.547633 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:25:38.547737 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:25:38.547756 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:25:38.547773 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:25:38.547788 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:25:38.547807 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:25:38.547823 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:25:38.849639 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:25:59.537530 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:25:59.537563 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:25:59.537579 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:25:59.537593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:25:59.537606 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:25:59.537618 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:25:59.537692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:25:59.840738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:26:00.672042 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:26:00.672071 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:26:00.672111 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:26:00.672124 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:26:00.672220 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:26:00.672283 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:26:00.672298 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:26:00.978097 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:26:30.118245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:26:30.118277 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:26:30.118363 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:26:30.118429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:26:30.118446 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:26:30.118462 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:26:30.118478 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:26:30.429312 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:26:31.237480 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:26:31.237525 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:26:31.237539 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:26:31.237554 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:26:31.237568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:26:31.237581 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:26:31.237650 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:26:31.541830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:26:38.673503 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:26:38.673533 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:26:38.673622 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:26:38.673687 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:26:38.673705 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:26:38.673725 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:26:38.673743 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:26:38.976980 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:27:00.690269 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:27:00.690304 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:27:00.690320 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:27:00.690335 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:27:00.690349 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:27:00.690364 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:27:00.690437 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:27:01.014821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:27:01.815223 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:27:01.815313 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:27:01.815332 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:27:01.815348 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:27:01.815362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:27:01.815378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:27:01.815392 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:27:02.120276 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:27:31.274920 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:27:31.274961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:27:31.274977 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:27:31.275002 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:27:31.275015 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:27:31.275026 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:27:31.275088 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:27:31.586766 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:27:32.386429 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:27:32.386459 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:27:32.386564 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:27:32.386639 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:27:32.386655 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:27:32.386671 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:27:32.386686 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:27:32.694606 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:27:38.802117 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:27:38.802143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:27:38.802250 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:27:38.802333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:27:38.802351 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:27:38.802367 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:27:38.802380 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:27:39.112300 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:28:01.854807 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:28:01.854843 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:28:01.854875 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:28:01.854888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:28:01.854904 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:28:01.854917 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:28:01.854986 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:28:02.167093 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:28:02.952846 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:28:02.952921 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:28:02.952938 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:28:02.952956 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:28:02.952968 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:28:02.952980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:28:02.952995 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:28:03.256172 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:28:32.434687 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:28:32.434792 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:28:32.434809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:28:32.434825 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:28:32.434856 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:28:32.434872 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:28:32.434885 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:28:32.742126 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:28:33.522605 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:28:33.522640 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:28:33.522744 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:28:33.522821 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:28:33.522841 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:28:33.522856 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:28:33.522871 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:28:33.824108 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:28:38.925692 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:28:38.925727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:28:38.925744 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:28:38.925757 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:28:38.925770 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:28:38.925859 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:28:38.925925 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:28:39.235473 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:29:03.010396 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:29:03.010428 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:29:03.010444 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:29:03.010525 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:29:03.010593 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:29:03.010610 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:29:03.010624 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:29:03.313280 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:29:04.091746 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:29:04.091779 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:29:04.091797 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:29:04.091811 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:29:04.091825 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:29:04.091839 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:29:04.091905 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:29:04.396731 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:29:33.577886 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:29:33.577918 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:29:33.578017 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:29:33.578093 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:29:33.578124 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:29:33.578140 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:29:33.578155 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:29:33.883865 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:29:34.664794 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:29:34.664823 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:29:34.664838 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:29:34.664852 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:29:34.664934 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:29:34.665008 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:29:34.665024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:29:34.972847 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:29:39.053646 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:29:39.053675 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:29:39.053760 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:29:39.053827 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:29:39.053843 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:29:39.053862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:29:39.053877 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:29:39.369625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:30:04.149731 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:30:04.149785 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:30:04.149871 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:30:04.149934 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:30:04.149951 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:30:04.149966 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:30:04.149980 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:30:04.461400 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:30:05.239649 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:30:05.239682 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:30:05.239714 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:30:05.239732 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:30:05.239828 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:30:05.239895 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:30:05.239913 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:30:05.551418 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:30:34.723100 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:30:34.723132 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:30:34.723148 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:30:34.723161 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:30:34.723174 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:30:34.723190 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:30:34.723256 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:30:35.036848 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:30:35.814497 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:30:35.814529 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:30:35.814560 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:30:35.814573 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:30:35.814673 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:30:35.814744 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:30:35.814760 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:30:36.119032 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:30:39.182431 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:30:39.182459 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:30:39.182545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:30:39.182608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:30:39.182623 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:30:39.182638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:30:39.182654 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:30:39.485418 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:31:05.311541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:31:05.311573 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:31:05.311605 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:31:05.311620 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:31:05.311635 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:31:05.311733 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:31:05.311825 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:31:05.612936 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:31:06.388474 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:31:06.388505 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:31:06.388535 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:31:06.388550 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:31:06.388649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:31:06.388729 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:31:06.388745 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:31:06.694354 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:31:35.873667 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:31:35.873711 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:31:35.873748 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:31:35.873762 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:31:35.873776 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:31:35.873872 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:31:35.873943 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:31:36.176073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:31:36.957117 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:31:36.957148 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:31:36.957183 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:31:36.957196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:31:36.957209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:31:36.957226 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:31:36.957288 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:31:37.263054 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:31:39.310890 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:31:39.310976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:31:39.310994 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:31:39.311010 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:31:39.311023 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:31:39.311036 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:31:39.311050 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:31:39.626215 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:32:06.433015 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:32:06.433048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:32:06.433082 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:32:06.433168 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:32:06.434200 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:32:06.434597 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:32:06.434893 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:32:06.742931 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:32:07.520093 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:32:07.520125 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:32:07.520156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:32:07.520250 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:32:07.520324 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:32:07.520340 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:32:07.520354 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:32:07.822578 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:32:37.001693 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:32:37.001728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:32:37.001760 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:32:37.001775 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:32:37.001866 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:32:37.001935 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:32:37.001951 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:32:37.311384 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:32:38.080709 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:32:38.080744 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:32:38.080844 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:32:38.080915 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:32:38.080932 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:32:38.080945 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:32:38.080961 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:32:38.381522 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:32:39.437645 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:32:39.437679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:32:39.437695 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:32:39.437722 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:32:39.437735 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:32:39.437749 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:32:39.437813 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:32:39.748671 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:33:07.570210 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:33:07.570310 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:33:07.570326 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:33:07.570341 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:33:07.570355 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:33:07.570370 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:33:07.570384 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:33:07.877210 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:33:08.647106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:33:08.647139 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:33:08.647156 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:33:08.647169 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:33:08.647184 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:33:08.647200 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:33:08.647264 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:33:08.954510 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:33:38.139793 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:33:38.139830 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:33:38.139969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:33:38.140051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:33:38.140068 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:33:38.140083 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:33:38.140099 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:33:38.440318 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:33:39.231361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:33:39.231392 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:33:39.231495 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:33:39.231573 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:33:39.231588 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:33:39.231605 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:33:39.231621 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:33:39.548572 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:33:39.809368 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:33:39.809399 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:33:39.809419 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:33:39.809434 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:33:39.809550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:33:39.809627 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:33:39.809643 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:33:40.121429 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:34:08.697805 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:34:08.697838 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:34:08.697958 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:34:08.698031 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:34:08.698049 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:34:08.698065 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:34:08.698081 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:34:09.003207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:34:09.810484 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:34:09.810571 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:34:09.810591 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:34:09.810605 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:34:09.810622 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:34:09.810635 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:34:09.810650 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:34:10.119222 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:34:39.268855 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:34:39.268891 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:34:39.268905 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:34:39.268917 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:34:39.268932 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:34:39.269024 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:34:39.269092 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:34:39.580517 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:34:39.841757 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:34:39.841790 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:34:39.841810 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:34:39.841826 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:34:39.841842 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:34:39.841937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:34:39.842011 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:34:40.146917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:34:40.409619 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:34:40.409652 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:34:40.409669 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:34:40.409683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:34:40.409696 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:34:40.409786 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:34:40.409861 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:34:40.709969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:35:09.843366 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:35:09.843400 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:35:09.843426 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:35:09.843457 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:35:09.843557 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:35:09.843624 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:35:09.843637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:35:10.148573 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:35:10.974346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:35:10.974435 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:35:10.974456 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:35:10.974471 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:35:10.974489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:35:10.974504 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:35:10.974518 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:35:11.276395 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:35:39.812050 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:35:39.812125 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:35:39.812142 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:35:39.812160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:35:39.812175 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:35:39.812189 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:35:39.812205 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:35:40.125487 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:35:40.408307 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:35:40.408345 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:35:40.408380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:35:40.408396 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:35:40.408411 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:35:40.408423 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:35:40.408498 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:35:40.710967 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:35:41.542240 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:35:41.542271 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:35:41.542373 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:35:41.542449 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:35:41.542466 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:35:41.542482 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:35:41.542496 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:35:41.847899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:36:10.971981 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:36:10.972063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:36:10.972085 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:36:10.972100 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:36:10.972113 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:36:10.972128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:36:10.972141 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:36:11.277520 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:36:12.110255 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:36:12.110292 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:36:12.110309 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:36:12.110412 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:36:12.110503 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:36:12.110522 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:36:12.110539 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:36:12.427744 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:36:39.940555 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:36:39.940586 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:36:39.940673 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:36:39.940759 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:36:39.940778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:36:39.940792 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:36:39.940806 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:36:40.251459 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:36:41.544142 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:36:41.544174 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:36:41.544263 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:36:41.544331 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:36:41.544348 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:36:41.544363 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:36:41.544378 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:36:41.850527 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:36:42.689562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:36:42.689592 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:36:42.689606 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:36:42.689621 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:36:42.689729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:36:42.689820 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:36:42.689839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:36:42.994479 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:37:12.118632 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:37:12.118739 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:37:12.118761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:37:12.118778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:37:12.118796 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:37:12.118813 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:37:12.118829 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:37:12.428836 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:37:13.256851 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:37:13.256879 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:37:13.256895 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:37:13.256913 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:37:13.256928 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:37:13.256947 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:37:13.257032 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:37:13.561894 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:37:40.072307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:37:40.072339 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:37:40.072354 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:37:40.072441 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:37:40.072515 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:37:40.072534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:37:40.072548 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:37:40.413816 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:37:42.688369 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:37:42.688399 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:37:42.688433 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:37:42.688449 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:37:42.688465 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:37:42.688478 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:37:42.688568 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:37:42.992435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:37:43.827810 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:37:43.827850 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:37:43.827881 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:37:43.827895 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:37:43.827907 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:37:43.828002 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:37:43.828073 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:37:44.135155 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:38:13.255131 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:38:13.255230 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:38:13.255249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:38:13.255264 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:38:13.255280 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:38:13.255297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:38:13.255312 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:38:13.564801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:38:14.407027 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:38:14.407063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:38:14.407077 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:38:14.407090 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down and a possible node drain is detected >2022-11-23 15:38:14.407103 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:38:14.407206 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:38:14.407273 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:38:14.719937 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:38:37.524047 E | op-k8sutil: timed out waiting for deployments to be updated >2022-11-23 15:38:37.524104 E | op-osd: failed to update OSD deployment "rook-ceph-osd-13": timed out waiting on deployment "rook-ceph-osd-13" >2022-11-23 15:38:37.524115 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 6 of 24 OSDs have been updated >2022-11-23 15:38:38.606580 I | op-osd: OSD 14 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 15:38:38.610585 I | op-osd: updating OSD 14 on PVC "ocs-deviceset-2-data-0dt89f" >2022-11-23 15:38:38.610615 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-0dt89f" and its metadata device on "ocs-deviceset-2-metadata-0ghkfb" >2022-11-23 15:38:38.610620 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-0m6ldf" >2022-11-23 15:38:38.610838 I | op-osd: assigning osd 14 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 15:38:39.749675 I | op-osd: updating OSD 15 on PVC "ocs-deviceset-2-data-1sg95c" >2022-11-23 15:38:39.749701 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-1sg95c" and its metadata device on "ocs-deviceset-2-metadata-1fdt8m" >2022-11-23 15:38:39.749705 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-1qgp84" >2022-11-23 15:38:39.749908 I | op-osd: assigning osd 15 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 15:38:40.201733 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:38:40.201830 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:38:40.201846 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:38:40.201865 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:38:40.201879 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:38:40.201895 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:38:40.201956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:38:40.505865 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:38:43.827225 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:38:43.827259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:38:43.827370 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:38:43.827388 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:38:43.827462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:38:43.827528 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:38:43.827544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:38:44.141062 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:38:44.982062 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:38:44.982137 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:38:44.982155 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:38:44.982176 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:38:44.982190 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:38:44.982205 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:38:44.982273 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:38:45.290899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:39:14.406055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:39:14.406154 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:39:14.406169 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:39:14.406233 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:39:14.406314 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:39:14.406329 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:39:14.406346 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:39:14.708895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:39:15.550388 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:39:15.550433 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:39:15.550528 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:39:15.550608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:39:15.550628 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:39:15.550644 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:39:15.550659 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:39:15.855157 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:39:40.339819 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:39:40.339850 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:39:40.339865 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:39:40.339881 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:39:40.339895 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:39:40.339954 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:39:40.340017 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:39:40.647205 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:39:44.967178 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:39:44.967210 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:39:44.967293 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:39:44.967358 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:39:44.967415 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:39:44.967429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:39:44.967443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:39:45.271326 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:39:46.121422 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:39:46.121528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:39:46.121625 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:39:46.121685 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:39:46.121704 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:39:46.121721 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:39:46.121735 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:39:46.435340 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:40:15.533026 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:40:15.533069 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:40:15.533084 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:40:15.533188 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:40:15.533203 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:40:15.533269 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:40:15.533333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:40:15.831419 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:40:16.699669 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:40:16.699818 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:40:16.699898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:40:16.699987 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:40:16.700003 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:40:16.700020 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:40:16.700039 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:40:17.005625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:40:40.483837 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:40:40.483865 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:40:40.483979 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:40:40.483996 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:40:40.484071 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:40:40.484150 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:40:40.484167 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:40:40.783100 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:40:46.090271 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:40:46.090365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:40:46.090383 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:40:46.090397 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:40:46.090413 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:40:46.090490 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:40:46.090506 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:40:46.398791 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:40:47.268035 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:40:47.268066 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:40:47.268165 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:40:47.268182 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:40:47.268264 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:40:47.268323 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:40:47.268337 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:40:47.574644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:41:16.660710 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:41:16.660755 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:41:16.660845 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:41:16.660859 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:41:16.660943 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:41:16.661066 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:41:16.661083 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:41:16.964373 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:41:17.844365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:41:17.844404 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:41:17.844420 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:41:17.844435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:41:17.844498 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:41:17.844513 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:41:17.844584 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:41:18.153254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:41:40.610407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:41:40.610441 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:41:40.610518 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:41:40.610576 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:41:40.610593 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:41:40.610609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:41:40.610622 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:41:40.921176 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:41:47.221475 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:41:47.221507 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:41:47.221523 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:41:47.221638 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:41:47.221656 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:41:47.221730 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:41:47.221807 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:41:47.531151 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:41:48.415230 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:41:48.415425 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:41:48.415452 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:41:48.415477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:41:48.415509 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:41:48.416020 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:41:48.416482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:41:48.721121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:42:17.823795 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:42:17.823882 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:42:17.823897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:42:17.823911 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:42:17.823926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:42:17.823942 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:42:17.824002 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:42:18.129526 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:42:18.987015 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:42:18.987051 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:42:18.987066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:42:18.987080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:42:18.987094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:42:18.987156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:42:18.987216 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:42:19.303043 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:42:40.737157 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:42:40.737185 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:42:40.737202 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:42:40.737286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:42:40.737351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:42:40.737413 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:42:40.737427 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:42:41.046939 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:42:48.389699 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:42:48.389740 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:42:48.389760 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:42:48.389881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:42:48.389958 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:42:48.390042 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:42:48.390058 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:42:48.690679 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:42:49.568882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:42:49.568916 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:42:49.568932 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:42:49.569029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:42:49.569102 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:42:49.569173 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:42:49.569189 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:42:49.882268 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:43:18.946813 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:43:18.946900 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:43:18.946921 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:43:18.946939 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:43:18.946958 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:43:18.947034 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:43:18.947052 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:43:19.255301 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:43:20.160982 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:43:20.161015 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:43:20.161031 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:43:20.161110 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:43:20.161172 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:43:20.161242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:43:20.161259 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:43:20.467437 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:43:40.864573 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:43:40.864672 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:43:40.864739 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:43:40.864802 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:43:40.864818 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:43:40.864833 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:43:40.864846 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:43:41.178966 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:43:49.519165 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:43:49.519270 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:43:49.519333 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:43:49.519400 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:43:49.519415 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:43:49.519432 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:43:49.519446 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:43:49.826457 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:43:50.737168 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:43:50.737324 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:43:50.737408 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:43:50.737498 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:43:50.737516 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:43:50.737530 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:43:50.737544 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:43:51.048592 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:44:20.097285 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:44:20.097397 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:44:20.097418 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:44:20.097436 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:44:20.097451 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:44:20.097519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:44:20.097538 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:44:20.409439 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:44:21.314101 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:44:21.314133 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:44:21.314148 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:44:21.314171 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:44:21.314238 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:44:21.314253 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:44:21.314328 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:44:21.614799 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:44:40.991034 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:44:40.991128 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:44:40.991194 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:44:40.991254 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:44:40.991270 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:44:40.991287 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:44:40.991301 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:44:41.303393 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:44:50.668576 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:44:50.668606 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:44:50.668671 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:44:50.668738 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:44:50.668756 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:44:50.668771 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:44:50.668788 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:44:50.971884 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:44:51.882998 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:44:51.883030 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:44:51.883112 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:44:51.883127 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:44:51.883185 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:44:51.883252 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:44:51.883267 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:44:52.207486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:45:21.233183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:45:21.233216 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:45:21.233287 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:45:21.233350 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:45:21.233365 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:45:21.233382 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:45:21.233396 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:45:21.542943 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:45:22.476085 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:45:22.476114 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:45:22.476146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:45:22.476163 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:45:22.476265 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:45:22.476350 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:45:22.476421 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:45:22.773964 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:45:41.114052 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:45:41.114155 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:45:41.114173 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:45:41.114250 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:45:41.114324 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:45:41.114342 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:45:41.114356 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:45:41.429488 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 15:45:51.797243 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:45:51.797333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:45:51.797350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:45:51.797988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:45:51.798016 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:45:51.798142 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:45:51.798296 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:45:52.114981 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:45:53.036217 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:45:53.036249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:45:53.036265 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:45:53.036280 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:45:53.036342 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:45:53.036356 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:45:53.036425 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:45:53.341696 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:46:22.388534 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:46:22.388621 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:46:22.388638 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:46:22.388654 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:46:22.388667 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:46:22.388733 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:46:22.388749 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:46:22.692138 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:46:23.607963 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:46:23.607994 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:46:23.608083 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:46:23.608097 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:46:23.608154 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:46:23.608235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:46:23.608251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:46:23.909810 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:46:41.236309 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:46:41.236340 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:46:41.236356 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:46:41.236435 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:46:41.236451 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:46:41.236512 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:46:41.236569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:46:41.548432 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:46:52.956376 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:46:52.956417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:46:52.956494 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:46:52.956508 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:46:52.956570 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:46:52.956630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:46:52.956644 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:46:53.261378 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:46:54.170845 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:46:54.170956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:46:54.171032 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:46:54.171099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:46:54.171116 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:46:54.171130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:46:54.171143 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:46:54.475473 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:47:23.524994 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:47:23.525025 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:47:23.525041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:47:23.525119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:47:23.525178 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:47:23.525242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:47:23.525256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:47:23.827261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:47:24.737135 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:47:24.737168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:47:24.737185 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:47:24.737199 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:47:24.737260 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:47:24.737275 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:47:24.737339 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:47:25.047235 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:47:41.355703 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:47:41.355799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:47:41.355815 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:47:41.355883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:47:41.355939 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:47:41.355954 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:47:41.355970 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:47:41.663400 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:47:54.090152 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:47:54.090187 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:47:54.090203 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:47:54.090218 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:47:54.090296 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:47:54.090367 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:47:54.090422 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:47:54.408468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:47:55.317025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:47:55.317146 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:47:55.317232 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:47:55.317305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:47:55.317320 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:47:55.317338 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:47:55.317351 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:47:55.620476 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:48:24.675251 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:48:24.675283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:48:24.675375 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:48:24.675442 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:48:24.675523 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:48:24.675539 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:48:24.675554 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:48:24.989143 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:48:25.881566 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:48:25.881656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:48:25.881674 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:48:25.881688 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:48:25.881702 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:48:25.881775 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:48:25.881790 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:48:26.194548 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:48:41.476398 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:48:41.476427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:48:41.476441 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:48:41.476523 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:48:41.476537 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:48:41.476600 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:48:41.476663 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:48:41.786782 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:48:55.261661 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:48:55.261692 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:48:55.261766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:48:55.261831 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:48:55.261846 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:48:55.261862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:48:55.261876 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:48:55.562364 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:48:56.461116 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:48:56.461211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:48:56.461229 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:48:56.461241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:48:56.461254 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:48:56.461271 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:48:56.461337 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:48:56.761984 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:49:25.821210 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:49:25.821244 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:49:25.821259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:49:25.821274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:49:25.821359 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:49:25.821428 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:49:25.821495 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:49:26.132634 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:49:27.019230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:49:27.019264 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:49:27.019337 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:49:27.019413 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:49:27.019429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:49:27.019444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:49:27.019460 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:49:27.322925 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:49:41.599726 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:49:41.599830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:49:41.599898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:49:41.599969 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:49:41.599986 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:49:41.600002 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:49:41.600016 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:49:41.907961 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:49:56.394948 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:49:56.395038 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:49:56.395098 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:49:56.395164 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:49:56.395182 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:49:56.395197 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:49:56.395212 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:49:56.696984 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:49:57.583748 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:49:57.583860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:49:57.583880 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:49:57.583894 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:49:57.583908 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:49:57.583969 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:49:57.583983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:49:57.892344 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:50:26.959917 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:50:26.960006 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:50:26.960070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:50:26.960133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:50:26.960159 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:50:26.960176 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:50:26.960190 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:50:27.267703 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:50:28.153899 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:50:28.154007 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:50:28.154074 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:50:28.154142 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:50:28.154159 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:50:28.154179 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:50:28.154195 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:50:28.465915 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:50:41.725104 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:50:41.725192 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:50:41.725257 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:50:41.725317 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:50:41.725334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:50:41.725348 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:50:41.725364 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:50:42.042056 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:50:57.530064 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:50:57.530097 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:50:57.530112 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:50:57.530125 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:50:57.530139 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:50:57.530201 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:50:57.530261 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:50:57.842258 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:50:58.733680 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:50:58.733713 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:50:58.733785 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:50:58.733848 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:50:58.733875 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:50:58.733891 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:50:58.733905 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:50:59.049278 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:51:28.100836 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:51:28.100869 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:51:28.100941 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:51:28.100998 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:51:28.101012 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:51:28.101029 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:51:28.101044 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:51:28.407613 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:51:29.323244 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:51:29.323363 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:51:29.323381 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:51:29.323399 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:51:29.323418 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:51:29.323489 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:51:29.323505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:51:29.640643 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:51:41.850273 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:51:41.850384 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:51:41.850409 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:51:41.850471 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:51:41.850537 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:51:41.850553 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:51:41.850570 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:51:42.161436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:51:58.665436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:51:58.665526 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:51:58.665543 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:51:58.665558 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:51:58.665572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:51:58.665643 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:51:58.665658 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:51:58.972162 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:51:59.912889 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:51:59.912921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:51:59.913028 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:51:59.913043 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:51:59.913112 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:51:59.913176 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:51:59.913192 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:52:00.225115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:52:29.240863 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:52:29.240898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:52:29.240913 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:52:29.240926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:52:29.240987 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:52:29.241001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:52:29.241062 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:52:29.551911 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:52:30.483840 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:52:30.483888 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:52:30.483904 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:52:30.483919 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:52:30.483987 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:52:30.484003 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:52:30.484072 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:52:30.786317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:52:41.969460 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:52:41.969547 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:52:41.969572 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:52:41.969588 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:52:41.969603 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:52:41.969664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:52:41.969681 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:52:42.297627 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:52:59.818961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:52:59.819009 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:52:59.819024 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:52:59.819039 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:52:59.819121 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:52:59.819181 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:52:59.819249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:53:00.134509 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:53:01.048456 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:53:01.048488 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:53:01.048504 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:53:01.048519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:53:01.048590 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:53:01.048614 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:53:01.048676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:53:01.353998 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:53:30.406785 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:53:30.406868 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:53:30.406889 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:53:30.406904 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:53:30.406921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:53:30.406986 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:53:30.407001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:53:30.721849 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:53:31.617857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:53:31.617887 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:53:31.617953 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:53:31.618012 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:53:31.618029 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:53:31.618043 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:53:31.618067 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:53:31.934252 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:53:42.091493 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:53:42.091577 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:53:42.091596 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:53:42.091613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:53:42.091629 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:53:42.091686 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:53:42.091701 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:53:42.405953 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:54:00.994599 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:54:00.994712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:54:00.994737 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:54:00.994751 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:54:00.994763 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:54:00.994834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:54:00.994848 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:54:01.299821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:54:02.212333 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:54:02.212365 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:54:02.212436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:54:02.212495 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:54:02.212509 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:54:02.212525 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:54:02.212539 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:54:02.519420 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:54:31.559708 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:54:31.559746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:54:31.559762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:54:31.559842 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:54:31.559907 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:54:31.559977 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:54:31.559994 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:54:31.878450 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:54:32.779139 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:54:32.779217 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:54:32.779236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:54:32.779249 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:54:32.779262 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:54:32.779276 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:54:32.779336 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:54:33.085738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:54:42.211003 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:54:42.211031 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:54:42.211109 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:54:42.211174 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:54:42.211234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:54:42.211250 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:54:42.211266 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:54:42.517695 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:55:02.149517 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:55:02.149629 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:55:02.149692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:55:02.149763 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:55:02.149781 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:55:02.149796 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:55:02.149810 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:55:02.456089 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:55:03.344407 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:55:03.344499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:55:03.344516 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:55:03.344530 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:55:03.344544 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:55:03.344559 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:55:03.344614 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:55:03.650192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:55:32.717324 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:55:32.717356 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:55:32.717375 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:55:32.717481 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:55:32.717554 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:55:32.717637 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:55:32.717654 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:55:33.020669 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:55:33.914406 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:55:33.914513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:55:33.914535 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:55:33.914554 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:55:33.914572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:55:33.914654 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:55:33.914671 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:55:34.226563 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:55:42.336322 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:55:42.336395 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:55:42.336411 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:55:42.336426 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:55:42.336440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:55:42.336455 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:55:42.336521 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:55:42.642255 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:56:03.278252 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:56:03.278282 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:56:03.278364 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:56:03.278379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:56:03.278443 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:56:03.278508 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:56:03.278523 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:56:03.590318 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:56:04.488115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:56:04.488148 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:56:04.488162 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:56:04.488242 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:56:04.488259 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:56:04.488321 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:56:04.488379 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:56:04.797492 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:56:33.851151 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:56:33.851186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:56:33.851202 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:56:33.851219 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:56:33.851315 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:56:33.851390 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:56:33.851467 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:56:34.153197 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:56:35.063621 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:56:35.063741 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:56:35.063811 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:56:35.063890 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:56:35.063905 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:56:35.063923 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:56:35.063936 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:56:35.375906 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:56:42.461395 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:56:42.461471 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:56:42.461487 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:56:42.461502 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:56:42.461521 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:56:42.461582 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:56:42.461598 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:56:42.768936 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:57:04.414564 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:57:04.414596 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:57:04.414675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:57:04.414690 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:57:04.414771 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:57:04.414840 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:57:04.414855 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:57:04.714927 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:57:05.640761 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:57:05.640792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:57:05.640808 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:57:05.640890 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:57:05.640956 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:57:05.641035 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:57:05.641050 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:57:05.938986 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:57:34.979462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:57:34.979544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:57:34.979559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:57:34.979575 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:57:34.979593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:57:34.979608 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:57:34.979667 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:57:35.287361 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:57:36.200738 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:57:36.200770 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:57:36.200802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:57:36.200899 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:57:36.200959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:57:36.201029 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:57:36.201045 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:57:36.508465 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:57:42.586490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:57:42.586518 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:57:42.586535 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:57:42.586611 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:57:42.586673 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:57:42.586740 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:57:42.586755 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:57:42.889454 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:58:05.580738 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:58:05.580770 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:58:05.580802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:58:05.580913 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:58:05.580928 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:58:05.580999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:58:05.581074 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:58:05.881920 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:58:06.767516 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:58:06.767585 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:58:06.767607 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:58:06.767700 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:58:06.767776 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:58:06.767847 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:58:06.767866 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:58:07.066871 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:58:36.137449 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:58:36.137532 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:58:36.137549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:58:36.137564 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:58:36.137577 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:58:36.137641 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:58:36.137656 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:58:36.450216 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:58:37.321153 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:58:37.321251 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:58:37.321269 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:58:37.321284 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:58:37.321310 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:58:37.321376 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:58:37.321389 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:58:37.623743 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:58:39.802796 E | op-k8sutil: timed out waiting for deployments to be updated >2022-11-23 15:58:39.802844 E | op-osd: failed to update OSD deployment "rook-ceph-osd-15": timed out waiting on deployment "rook-ceph-osd-15" >2022-11-23 15:58:39.802855 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 8 of 24 OSDs have been updated >2022-11-23 15:58:40.894580 I | op-osd: OSD 16 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 15:58:40.898311 I | op-osd: updating OSD 16 on PVC "ocs-deviceset-2-data-2dtlkq" >2022-11-23 15:58:40.898333 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-2dtlkq" and its metadata device on "ocs-deviceset-2-metadata-2ngfs9" >2022-11-23 15:58:40.898338 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-2prbmt" >2022-11-23 15:58:40.898559 I | op-osd: assigning osd 16 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 15:58:42.051985 I | op-osd: OSD 17 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 15:58:42.056695 I | op-osd: updating OSD 17 on PVC "ocs-deviceset-2-data-39nfvc" >2022-11-23 15:58:42.056712 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-39nfvc" and its metadata device on "ocs-deviceset-2-metadata-324rgb" >2022-11-23 15:58:42.056721 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-3lwhts" >2022-11-23 15:58:42.056928 I | op-osd: assigning osd 17 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 15:58:42.706368 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down and a possible node drain is detected >2022-11-23 15:58:42.706462 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:58:42.706535 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:58:42.706597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:58:42.706614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:58:42.706628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:58:42.706642 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:58:43.027058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:58:43.217453 I | op-osd: OSD 18 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 15:58:43.221768 I | op-osd: updating OSD 18 on PVC "ocs-deviceset-2-data-65vppw" >2022-11-23 15:58:43.221784 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-65vppw" and its metadata device on "ocs-deviceset-2-metadata-6mlfv7" >2022-11-23 15:58:43.221788 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-6qtnqg" >2022-11-23 15:58:43.221993 I | op-osd: assigning osd 18 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 15:58:44.357133 I | op-osd: updating OSD 19 on PVC "ocs-deviceset-2-data-4qsl7c" >2022-11-23 15:58:44.357155 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-4qsl7c" and its metadata device on "ocs-deviceset-2-metadata-457pkl" >2022-11-23 15:58:44.357159 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-4q8dnm" >2022-11-23 15:58:44.357348 I | op-osd: assigning osd 19 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 15:59:06.707419 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:59:06.707449 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:59:06.707463 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:59:06.707577 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 15:59:06.707655 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:59:06.707730 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:59:06.707793 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:59:07.014442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:59:07.885521 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:59:07.885623 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 15:59:07.885738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:59:07.885817 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:59:07.885849 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:59:07.885875 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:59:07.885891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:59:08.184206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:59:37.276016 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:59:37.276109 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 15:59:37.276175 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:59:37.276234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:59:37.276298 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:59:37.276316 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:59:37.276333 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:59:37.582910 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:59:38.453966 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:59:38.454079 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 15:59:38.454156 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:59:38.454240 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:59:38.454257 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:59:38.454273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:59:38.454293 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:59:38.756283 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 15:59:42.832818 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 15:59:42.832912 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 15:59:42.832991 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 15:59:42.833067 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 15:59:42.833087 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 15:59:42.833107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 15:59:42.833124 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 15:59:43.137223 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:00:07.838875 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:00:07.838980 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:00:07.839004 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:00:07.839023 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:00:07.839042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:00:07.839116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:00:07.839193 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:00:08.144130 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:00:09.019223 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:00:09.019303 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:00:09.019364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:00:09.019436 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:00:09.019454 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:00:09.019470 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:00:09.019485 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:00:09.329804 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:00:38.406375 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:00:38.406463 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:00:38.406482 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:00:38.406497 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:00:38.406512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:00:38.406573 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:00:38.406637 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:00:38.710521 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:00:39.595302 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:00:39.595392 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:00:39.595406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:00:39.595420 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:00:39.595434 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:00:39.595501 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:00:39.595556 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:00:39.900302 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:00:42.949684 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:00:42.949766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:00:42.949782 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:00:42.949799 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:00:42.949815 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:00:42.949884 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:00:42.949953 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:00:43.254098 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:01:08.977103 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:01:08.977672 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:01:08.977701 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:01:08.977728 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:01:08.977747 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:01:08.977824 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:01:08.977896 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:01:09.285235 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:01:10.173189 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:01:10.173302 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:01:10.173382 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:01:10.173449 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:01:10.173465 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:01:10.173479 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:01:10.173495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:01:10.478028 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:01:39.549651 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:01:39.549693 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:01:39.549730 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:01:39.549815 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:01:39.549878 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:01:39.549942 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:01:39.550003 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:01:39.860852 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:01:40.741356 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:01:40.741447 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:01:40.741465 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:01:40.741479 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:01:40.741493 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:01:40.741558 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:01:40.741614 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:01:41.049639 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:01:43.072899 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:01:43.072980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:01:43.073053 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:01:43.073126 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:01:43.073157 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:01:43.073174 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:01:43.073190 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:01:43.383464 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:02:10.127379 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:02:10.127472 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:02:10.127540 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:02:10.127616 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:02:10.127679 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:02:10.127695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:02:10.127710 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:02:10.435019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:02:11.314237 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:02:11.314336 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:02:11.314405 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:02:11.314471 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:02:11.314533 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:02:11.314549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:02:11.314566 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:02:11.630337 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:02:40.701180 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:02:40.701212 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:02:40.701228 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:02:40.701308 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:02:40.701383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:02:40.701445 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:02:40.701517 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:02:41.003661 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:02:41.892135 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:02:41.892215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:02:41.892284 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:02:41.892347 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:02:41.892362 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:02:41.892380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:02:41.892394 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:02:42.204412 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:02:43.192467 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:02:43.192545 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:02:43.192565 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:02:43.192580 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:02:43.192593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:02:43.192657 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:02:43.192724 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:02:43.497816 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:03:11.267010 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:03:11.267088 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:03:11.267105 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:03:11.267121 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:03:11.267136 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:03:11.267222 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:03:11.267285 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:03:11.576580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:03:12.474308 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:03:12.474398 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:03:12.474461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:03:12.474523 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:03:12.474581 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:03:12.474599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:03:12.474614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:03:12.777682 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:03:41.839506 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:03:41.839601 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:03:41.839666 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:03:41.839746 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:03:41.839820 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:03:41.839835 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:03:41.839848 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:03:42.159512 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:03:43.043992 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:03:43.044084 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:03:43.044152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:03:43.044241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:03:43.044262 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:03:43.044279 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:03:43.044296 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:03:43.349102 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:03:43.610998 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:03:43.611094 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:03:43.611111 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:03:43.611127 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:03:43.611140 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:03:43.611197 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:03:43.611258 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:03:43.921945 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:04:12.421532 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:04:12.421629 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:04:12.421701 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:04:12.421782 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:04:12.421852 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:04:12.421872 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:04:12.421899 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:04:12.721461 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:04:13.612758 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:04:13.612838 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:04:13.612910 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:04:13.612976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:04:13.612993 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:04:13.613008 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:04:13.613022 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:04:13.921522 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:04:42.984385 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:04:42.984467 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:04:42.984539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:04:42.984615 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:04:42.984630 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:04:42.984646 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:04:42.984661 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:04:43.294864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:04:43.572969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:04:43.573070 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:04:43.573085 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:04:43.573100 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:04:43.573114 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:04:43.573192 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:04:43.573266 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:04:43.881700 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:04:44.182218 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:04:44.182313 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:04:44.182329 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:04:44.182343 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:04:44.182358 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:04:44.182427 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:04:44.182497 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:04:44.505393 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:05:13.572986 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:05:13.573082 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:05:13.573098 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:05:13.573113 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:05:13.573127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:05:13.573193 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:05:13.573255 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:05:13.880401 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:05:14.770211 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:05:14.770321 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:05:14.770338 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:05:14.770353 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:05:14.770368 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:05:14.770431 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:05:14.770490 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:05:15.073135 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:05:43.557630 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:05:43.557738 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:05:43.557814 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:05:43.557890 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:05:43.557908 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:05:43.557928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:05:43.557944 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:05:43.858839 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:05:44.141053 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:05:44.141084 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:05:44.141098 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:05:44.141184 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:05:44.141259 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:05:44.141320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:05:44.141379 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:05:44.447242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:05:45.332233 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:05:45.332262 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:05:45.332346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:05:45.332405 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:05:45.332479 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:05:45.332537 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:05:45.332552 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:05:45.640373 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:06:14.708736 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:06:14.708855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:06:14.708917 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:06:14.708977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:06:14.709038 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:06:14.709053 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:06:14.709067 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:06:15.015757 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:06:15.902933 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:06:15.902963 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:06:15.902979 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:06:15.903061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:06:15.903123 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:06:15.903184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:06:15.903249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:06:16.209312 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:06:43.675197 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:06:43.675227 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:06:43.675308 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:06:43.675393 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:06:43.675457 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:06:43.675517 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:06:43.675532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:06:43.979541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:06:45.276777 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:06:45.276875 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:06:45.276936 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:06:45.277007 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:06:45.277076 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:06:45.277089 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:06:45.277104 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:06:45.579597 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:06:46.471741 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:06:46.471826 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:06:46.471884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:06:46.471951 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:06:46.471969 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:06:46.471985 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:06:46.471999 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:06:46.783445 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:07:15.838130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:07:15.838160 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:07:15.838239 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:07:15.838300 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:07:15.838368 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:07:15.838429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:07:15.838444 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:07:16.145376 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:07:17.051407 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:07:17.051449 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:07:17.051551 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:07:17.051613 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:07:17.051678 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:07:17.051742 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:07:17.051759 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:07:17.348215 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:07:43.803696 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:07:43.803731 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:07:43.803816 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:07:43.803879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:07:43.803939 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:07:43.804003 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:07:43.804019 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:07:44.117285 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:07:46.409583 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:07:46.409617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:07:46.409631 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:07:46.409645 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:07:46.409706 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:07:46.409771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:07:46.409829 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:07:46.718520 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:07:47.611681 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:07:47.611712 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:07:47.611736 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:07:47.611817 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:07:47.611878 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:07:47.611950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:07:47.612010 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:07:47.920779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:08:16.983540 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:08:16.983582 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:08:16.983613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:08:16.983628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:08:16.983693 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:08:16.983762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:08:16.983818 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:08:17.289061 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:08:18.182227 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:08:18.182347 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:08:18.182453 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:08:18.182552 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:08:18.182571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:08:18.182592 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:08:18.182613 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:08:18.489501 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:08:43.924228 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:08:43.924308 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:08:43.924334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:08:43.924349 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:08:43.924363 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:08:43.924422 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:08:43.924484 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:08:44.232663 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:08:47.550503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:08:47.550631 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:08:47.550705 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:08:47.550802 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:08:47.550884 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:08:47.550900 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:08:47.550917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:08:47.865800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:08:48.757507 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:08:48.757632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:08:48.757666 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:08:48.757684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:08:48.757702 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:08:48.757777 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:08:48.757853 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:08:49.070022 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:09:18.120414 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:09:18.120445 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:09:18.120460 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:09:18.120545 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:09:18.120614 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:09:18.120684 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:09:18.120757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:09:18.422392 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:09:19.336711 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:09:19.336795 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:09:19.336860 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:09:19.336934 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:09:19.336952 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:09:19.336967 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:09:19.336980 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:09:19.641999 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:09:44.046047 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:09:44.046157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:09:44.046219 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:09:44.046281 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:09:44.046344 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:09:44.046360 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:09:44.046376 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:09:44.350246 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:09:48.679279 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:09:48.679366 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:09:48.679436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:09:48.679498 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:09:48.679516 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:09:48.679530 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:09:48.679544 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:09:48.985842 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:09:49.911559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:09:49.911591 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:09:49.911606 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:09:49.911688 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:09:49.911769 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:09:49.911830 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:09:49.911889 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:09:50.216129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:10:19.247327 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:10:19.247359 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:10:19.247374 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:10:19.247459 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:10:19.247526 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:10:19.247585 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:10:19.247656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:10:19.563322 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:10:20.474109 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:10:20.474142 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:10:20.474158 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:10:20.474171 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:10:20.474229 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:10:20.474298 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:10:20.474360 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:10:20.779329 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:10:44.169345 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:10:44.169425 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:10:44.169441 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:10:44.169455 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:10:44.169469 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:10:44.169532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:10:44.169594 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:10:44.485666 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:10:49.826249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:10:49.826288 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:10:49.826307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:10:49.826430 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:10:49.826519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:10:49.826617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:10:49.826702 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:10:50.139439 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:10:51.045348 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:10:51.045461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:10:51.045537 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:10:51.045616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:10:51.045635 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:10:51.045655 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:10:51.045671 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:10:51.349734 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:11:20.404849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:11:20.404990 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:11:20.405009 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:11:20.405029 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:11:20.405043 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:11:20.405125 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:11:20.405205 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:11:20.707753 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:11:21.615454 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:11:21.615531 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:11:21.615550 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:11:21.615567 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:11:21.615580 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:11:21.615647 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:11:21.615722 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:11:21.917862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:11:44.296506 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:11:44.296539 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:11:44.296555 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:11:44.296570 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:11:44.296646 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:11:44.296734 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:11:44.296805 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:11:44.599491 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:11:50.971258 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:11:50.971293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:11:50.971308 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:11:50.971321 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:11:50.971383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:11:50.971457 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:11:50.971528 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:11:51.282841 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:11:52.187341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:11:52.187421 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:11:52.187438 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:11:52.187460 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:11:52.187474 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:11:52.187540 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:11:52.187603 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:11:52.490203 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:12:21.543803 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:12:21.543900 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:12:21.543964 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:12:21.544025 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:12:21.544041 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:12:21.544056 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:12:21.544071 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:12:21.853505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:12:22.749427 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:12:22.749504 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:12:22.749567 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:12:22.749625 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:12:22.749640 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:12:22.749657 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:12:22.749671 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:12:23.053945 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:12:44.416644 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:12:44.416732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:12:44.416748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:12:44.416765 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:12:44.416778 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:12:44.416844 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:12:44.416909 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:12:44.721693 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:12:52.121027 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:12:52.121115 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:12:52.121132 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:12:52.121146 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:12:52.121160 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:12:52.121220 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:12:52.121293 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:12:52.426207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:12:53.318000 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:12:53.318115 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:12:53.318197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:12:53.318270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:12:53.318351 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:12:53.318370 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:12:53.318387 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:12:53.633682 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:13:22.690729 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:13:22.690834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:13:22.690909 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:13:22.690990 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:13:22.691005 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:13:22.691020 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:13:22.691036 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:13:22.986244 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:13:23.892520 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:13:23.892606 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:13:23.892628 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:13:23.892644 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:13:23.892658 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:13:23.892724 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:13:23.892792 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:13:24.197040 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:13:44.537552 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:13:44.537581 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:13:44.537671 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:13:44.537744 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:13:44.537812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:13:44.537880 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:13:44.537897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:13:44.846830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:13:53.251134 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:13:53.251263 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:13:53.251328 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:13:53.251389 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:13:53.251449 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:13:53.251466 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:13:53.251479 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:13:53.553503 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:13:54.463800 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:13:54.463829 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:13:54.463843 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:13:54.463956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:13:54.464028 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:13:54.464087 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:13:54.464148 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:13:54.771039 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:14:23.813629 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:14:23.813765 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:14:23.813833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:14:23.813902 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:14:23.813918 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:14:23.813933 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:14:23.813946 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:14:24.119429 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:14:25.033161 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:14:25.033242 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:14:25.033310 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:14:25.033370 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:14:25.033388 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:14:25.033404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:14:25.033417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:14:25.346371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:14:44.659280 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:14:44.659760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:14:44.659822 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:14:44.659851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:14:44.659875 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:14:44.660153 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:14:44.660984 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:14:44.964100 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:14:54.405080 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:14:54.405115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:14:54.405130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:14:54.405146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:14:54.405220 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:14:54.405288 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:14:54.405348 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:14:54.717625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:14:55.617596 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:14:55.617629 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:14:55.617732 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:14:55.617826 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:14:55.617887 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:14:55.617948 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:14:55.617964 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:14:55.930766 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:15:24.980452 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:15:24.980549 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:15:24.980615 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:15:24.980675 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:15:24.980692 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:15:24.980710 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:15:24.980731 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:15:25.295519 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:15:26.192671 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:15:26.192797 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:15:26.192870 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:15:26.192929 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:15:26.192988 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:15:26.193003 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:15:26.193018 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:15:26.506052 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:15:44.786845 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:15:44.786925 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:15:44.786944 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:15:44.786963 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:15:44.786980 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:15:44.787048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:15:44.787108 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:15:45.101925 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:15:55.557945 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:15:55.558023 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:15:55.558039 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:15:55.558055 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:15:55.558068 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:15:55.558128 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:15:55.558190 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:15:55.862923 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:15:56.766574 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:15:56.766681 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:15:56.766780 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:15:56.766850 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:15:56.766929 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:15:56.766949 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:15:56.766966 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:15:57.068740 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:16:26.125822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:16:26.125853 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:16:26.125933 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:16:26.125996 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:16:26.126057 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:16:26.126122 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:16:26.126138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:16:26.438505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:16:27.328048 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:16:27.328135 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:16:27.328153 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:16:27.328171 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:16:27.328185 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:16:27.328263 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:16:27.328337 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:16:27.635017 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:16:44.917817 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:16:44.917942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:16:44.918036 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:16:44.918140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:16:44.918215 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:16:44.918234 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:16:44.918253 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:16:45.222287 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:16:56.715238 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:16:56.715272 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:16:56.715287 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:16:56.715301 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:16:56.715368 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:16:56.715435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:16:56.715503 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:16:57.025915 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:16:57.893900 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:16:57.894003 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:16:57.894061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:16:57.894137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:16:57.894198 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:16:57.894214 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:16:57.894230 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:16:58.196684 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:17:27.289222 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:17:27.289343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:17:27.289428 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:17:27.289516 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:17:27.289534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:17:27.289553 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:17:27.289570 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:17:27.598311 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:17:28.462518 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:17:28.462620 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:17:28.462637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:17:28.462655 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:17:28.462669 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:17:28.462756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:17:28.462835 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:17:28.760131 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:17:45.045893 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:17:45.046016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:17:45.046032 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:17:45.046048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:17:45.046066 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:17:45.046147 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:17:45.046221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:17:45.356747 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:17:57.857845 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:17:57.857973 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:17:57.858045 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:17:57.858127 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:17:57.858214 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:17:57.858232 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:17:57.858246 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:17:58.164486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:17:59.026926 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:17:59.026958 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:17:59.027055 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:17:59.027120 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:17:59.027188 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:17:59.027258 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:17:59.027273 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:17:59.332697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:18:28.423131 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:18:28.423167 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:18:28.423181 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:18:28.423195 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:18:28.423266 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:18:28.423344 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:18:28.423403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:18:28.726363 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:18:29.595219 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:18:29.595302 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:18:29.595365 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:18:29.595427 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:18:29.595444 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:18:29.595461 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:18:29.595476 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:18:29.896729 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:18:44.415776 E | op-k8sutil: timed out waiting for deployments to be updated >2022-11-23 16:18:44.415819 E | op-osd: failed to update OSD deployment "rook-ceph-osd-19": timed out waiting on deployment "rook-ceph-osd-19" >2022-11-23 16:18:44.415850 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 12 of 24 OSDs have been updated >2022-11-23 16:18:45.173709 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down and a possible node drain is detected >2022-11-23 16:18:45.173837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:18:45.173915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:18:45.173986 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:18:45.174070 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:18:45.174086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:18:45.174104 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:18:45.477553 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:18:45.518366 I | op-osd: OSD 2 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 16:18:45.523050 I | op-osd: updating OSD 2 on PVC "ocs-deviceset-0-data-5ks6wf" >2022-11-23 16:18:45.523066 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-5ks6wf" and its metadata device on "ocs-deviceset-0-metadata-5l7x2m" >2022-11-23 16:18:45.523069 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-57pv6z" >2022-11-23 16:18:45.523294 I | op-osd: assigning osd 2 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 16:18:46.656092 I | op-osd: OSD 20 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 16:18:46.660298 I | op-osd: updating OSD 20 on PVC "ocs-deviceset-2-data-56s2sg" >2022-11-23 16:18:46.660323 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-56s2sg" and its metadata device on "ocs-deviceset-2-metadata-5wczjg" >2022-11-23 16:18:46.660327 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-5s226m" >2022-11-23 16:18:46.660538 I | op-osd: assigning osd 20 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 16:18:47.877180 I | op-osd: OSD 21 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 16:18:47.881004 I | op-osd: updating OSD 21 on PVC "ocs-deviceset-1-data-7kf4tb" >2022-11-23 16:18:47.881020 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-7kf4tb" and its metadata device on "ocs-deviceset-1-metadata-7ll7pw" >2022-11-23 16:18:47.881023 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-79jmc9" >2022-11-23 16:18:47.881227 I | op-osd: assigning osd 21 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 16:18:49.015607 I | op-osd: OSD 22 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 16:18:49.020519 I | op-osd: updating OSD 22 on PVC "ocs-deviceset-0-data-7bznfx" >2022-11-23 16:18:49.020534 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-7bznfx" and its metadata device on "ocs-deviceset-0-metadata-7bdqfj" >2022-11-23 16:18:49.020537 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-7jps5n" >2022-11-23 16:18:49.020748 I | op-osd: assigning osd 22 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 16:18:50.176775 I | op-osd: OSD 23 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 16:18:50.181055 I | op-osd: updating OSD 23 on PVC "ocs-deviceset-2-data-72v4qp" >2022-11-23 16:18:50.181075 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-72v4qp" and its metadata device on "ocs-deviceset-2-metadata-7l8wjf" >2022-11-23 16:18:50.181079 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-7nf8xz" >2022-11-23 16:18:50.181284 I | op-osd: assigning osd 23 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 16:18:51.316942 I | op-osd: OSD 3 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 16:18:51.321589 I | op-osd: updating OSD 3 on PVC "ocs-deviceset-0-data-4bjtfw" >2022-11-23 16:18:51.321607 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-4bjtfw" and its metadata device on "ocs-deviceset-0-metadata-4fff89" >2022-11-23 16:18:51.321611 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-4xgsvz" >2022-11-23 16:18:51.321795 I | op-osd: assigning osd 3 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 16:18:52.511762 I | op-osd: updating OSD 4 on PVC "ocs-deviceset-0-data-1vd6t2" >2022-11-23 16:18:52.511783 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-1vd6t2" and its metadata device on "ocs-deviceset-0-metadata-1jdkcg" >2022-11-23 16:18:52.511787 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-1r6b2z" >2022-11-23 16:18:52.511984 I | op-osd: assigning osd 4 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 16:18:58.989047 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:18:58.989078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:18:58.989093 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:18:58.989150 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:18:58.989206 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:18:58.989263 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:18:58.989321 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:18:59.297666 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:19:00.160333 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:19:00.160416 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:19:00.160432 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:19:00.160447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:19:00.160498 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:19:00.160588 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:19:00.160646 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:19:00.471813 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:19:29.564861 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:19:29.564952 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:19:29.565014 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:19:29.565098 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:19:29.565123 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:19:29.565139 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:19:29.565198 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:19:29.862547 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:19:30.741712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:19:30.741751 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:19:30.741765 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:19:30.741821 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:19:30.741899 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:19:30.741953 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:19:30.742014 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:19:31.040024 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:19:45.301534 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:19:45.301608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:19:45.301625 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:19:45.301642 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:19:45.301712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:19:45.301788 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:19:45.301871 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:19:45.613647 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:20:00.133815 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:20:00.133904 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:20:00.133976 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:20:00.134051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:20:00.134068 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:20:00.134085 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:20:00.134143 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:20:00.443450 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:20:01.302664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:20:01.302752 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:20:01.302816 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:20:01.302883 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:20:01.302900 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:20:01.302915 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:20:01.302973 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:20:01.612207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:20:30.710678 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:20:30.710764 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:20:30.710837 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:20:30.710905 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:20:30.710922 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:20:30.710940 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:20:30.711000 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:20:31.021794 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:20:31.878880 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:20:31.878967 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:20:31.878983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:20:31.878999 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:20:31.879057 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:20:31.879121 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:20:31.879183 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:20:32.198970 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:20:45.434773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:20:45.434844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:20:45.434906 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:20:45.434966 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:20:45.434981 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:20:45.434999 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:20:45.435071 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:20:45.741986 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:21:01.282850 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:21:01.282937 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:21:01.282954 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:21:01.282970 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:21:01.283040 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:21:01.283112 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:21:01.283176 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:21:01.593805 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:21:02.460059 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:21:02.460163 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:21:02.460237 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:21:02.460307 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:21:02.460325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:21:02.460340 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:21:02.460414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:21:02.768104 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:21:31.862575 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:21:31.862675 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:21:31.862752 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:21:31.862810 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:21:31.862874 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:21:31.862891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:21:31.862907 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:21:32.176002 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:21:33.031700 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:21:33.031786 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:21:33.031854 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:21:33.031919 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:21:33.031934 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:21:33.031950 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:21:33.032007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:21:33.338847 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:21:45.563603 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:21:45.563684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:21:45.563755 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:21:45.563816 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:21:45.563831 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:21:45.563848 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:21:45.563921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:21:45.870687 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:22:02.444154 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:22:02.444184 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:22:02.444216 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:22:02.444299 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:22:02.444363 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:22:02.444421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:22:02.444477 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:22:02.752569 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:22:03.594678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:22:03.594711 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:22:03.594790 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:22:03.594868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:22:03.594929 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:22:03.594987 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:22:03.595047 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:22:03.904344 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:22:33.019373 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:22:33.019464 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:22:33.019527 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:22:33.019596 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:22:33.019660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:22:33.019676 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:22:33.019692 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:22:33.325227 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:22:34.166242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:22:34.166275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:22:34.166292 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:22:34.166353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:22:34.166417 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:22:34.166478 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:22:34.166540 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:22:34.479107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:22:45.690502 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:22:45.690599 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:22:45.690663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:22:45.690733 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:22:45.690794 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:22:45.690855 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:22:45.690870 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:22:46.000245 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:23:03.589050 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:23:03.589138 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:23:03.589155 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:23:03.589170 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:23:03.589233 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:23:03.589294 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:23:03.589361 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:23:03.894946 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:23:04.744609 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:23:04.744688 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:23:04.744773 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:23:04.744832 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:23:04.744850 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:23:04.744868 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:23:04.744928 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:23:05.055121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:23:34.157962 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:23:34.158060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:23:34.158139 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:23:34.158222 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:23:34.158240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:23:34.158257 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:23:34.158330 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:23:34.466513 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:23:35.322886 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:23:35.322920 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:23:35.322937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:23:35.323002 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:23:35.323067 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:23:35.323138 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:23:35.323222 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:23:35.627664 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:23:45.818479 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:23:45.818554 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:23:45.818618 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:23:45.818678 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:23:45.818696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:23:45.818712 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:23:45.818778 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:23:46.129143 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:24:04.728914 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:24:04.728946 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:24:04.728964 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:24:04.729046 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:24:04.729110 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:24:04.729177 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:24:04.729239 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:24:05.035213 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:24:05.888141 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:24:05.888174 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:24:05.888256 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:24:05.888338 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:24:05.888431 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:24:05.888505 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:24:05.888572 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:24:06.188604 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:24:35.302189 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:24:35.302302 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:24:35.302376 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:24:35.302434 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:24:35.302506 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:24:35.302522 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:24:35.302539 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:24:35.615110 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:24:36.452847 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:24:36.452956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:24:36.453038 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:24:36.453109 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:24:36.453189 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:24:36.453207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:24:36.453226 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:24:36.754984 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:24:45.947825 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:24:45.947931 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:24:45.947948 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:24:45.947967 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:24:45.948043 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:24:45.948119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:24:45.948212 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:24:46.250560 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:25:05.872679 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:25:05.872768 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:25:05.872842 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:25:05.872904 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:25:05.872919 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:25:05.872936 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:25:05.873001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:25:06.176689 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:25:07.015750 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:25:07.015829 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:25:07.015902 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:25:07.015968 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:25:07.015985 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:25:07.016001 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:25:07.016064 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:25:07.317311 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:25:36.439728 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:25:36.439820 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:25:36.439838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:25:36.439855 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:25:36.439933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:25:36.440018 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:25:36.440099 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:25:36.744211 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:25:37.589063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:25:37.589171 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:25:37.589245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:25:37.589313 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:25:37.589385 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:25:37.589453 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:25:37.589468 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:25:37.896355 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:25:46.074603 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:25:46.074681 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:25:46.074697 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:25:46.074713 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:25:46.074784 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:25:46.074848 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:25:46.074909 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:25:46.379497 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:26:07.004706 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:26:07.004804 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:26:07.004828 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:26:07.004844 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:26:07.004910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:26:07.004975 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:26:07.005037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:26:07.313705 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:26:08.151449 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:26:08.151532 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:26:08.151592 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:26:08.151664 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:26:08.151685 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:26:08.151702 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:26:08.151768 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:26:08.452738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:26:37.573309 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:26:37.573414 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:26:37.573432 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:26:37.573447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:26:37.573538 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:26:37.573616 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:26:37.573697 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:26:37.879913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:26:38.719002 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:26:38.719099 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:26:38.719178 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:26:38.719256 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:26:38.719271 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:26:38.719285 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:26:38.719354 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:26:39.021166 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:26:46.204854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:26:46.204883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:26:46.204965 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:26:46.205035 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:26:46.205101 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:26:46.205163 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:26:46.205226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:26:46.507834 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:27:08.137799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:27:08.137879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:27:08.137948 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:27:08.138019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:27:08.138037 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:27:08.138052 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:27:08.138112 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:27:08.448306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:27:09.291001 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:27:09.291077 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:27:09.291094 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:27:09.291118 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:27:09.291179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:27:09.291242 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:27:09.291302 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:27:09.591796 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:27:38.708423 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:27:38.708509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:27:38.708591 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:27:38.708654 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:27:38.708670 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:27:38.708686 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:27:38.708755 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:27:39.017825 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:27:39.856156 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:27:39.856283 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:27:39.856360 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:27:39.856440 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:27:39.856522 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:27:39.856604 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:27:39.856619 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:27:40.173782 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:27:46.334279 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:27:46.334370 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:27:46.334443 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:27:46.334518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:27:46.334537 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:27:46.334553 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:27:46.334624 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:27:46.647777 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:28:09.286053 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:28:09.286139 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:28:09.286218 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:28:09.286276 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:28:09.286343 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:28:09.286359 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:28:09.286377 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:28:09.595579 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:28:10.433929 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:28:10.434019 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:28:10.434083 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:28:10.434136 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:28:10.434194 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:28:10.434209 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:28:10.434225 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:28:10.739893 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:28:39.858163 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:28:39.858197 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:28:39.858302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:28:39.858381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:28:39.858462 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:28:39.858527 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:28:39.858602 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:28:40.174875 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:28:41.001441 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:28:41.001542 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:28:41.001613 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:28:41.001677 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:28:41.001748 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:28:41.001767 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:28:41.001783 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:28:41.311270 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:28:46.464101 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:28:46.464180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:28:46.464198 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:28:46.464214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:28:46.464275 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:28:46.464350 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:28:46.464414 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:28:46.771311 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:29:10.439609 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:29:10.439693 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:29:10.439779 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:29:10.439849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:29:10.439909 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:29:10.439927 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:29:10.439943 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:29:10.736124 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:29:11.572418 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:29:11.573055 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:29:11.573141 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:29:11.573237 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:29:11.573272 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:29:11.573293 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:29:11.573365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:29:11.902487 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:29:40.994201 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:29:40.994279 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:29:40.994295 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:29:40.994312 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:29:40.994375 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:29:40.994433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:29:40.994500 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:29:41.299166 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:29:42.175766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:29:42.175805 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:29:42.175884 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:29:42.175964 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:29:42.176038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:29:42.176108 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:29:42.176173 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:29:42.488732 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:29:46.587621 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:29:46.587730 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:29:46.587803 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:29:46.587872 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:29:46.587935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:29:46.587999 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:29:46.588014 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:29:46.894335 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:30:11.560372 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:30:11.560405 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:30:11.560472 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:30:11.560552 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:30:11.560613 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:30:11.560677 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:30:11.560747 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:30:11.877103 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:30:12.745570 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:30:12.745668 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:30:12.745754 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:30:12.745848 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:30:12.745865 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:30:12.745882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:30:12.745954 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:30:13.049951 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:30:42.155026 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:30:42.155143 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:30:42.155221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:30:42.155291 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:30:42.155357 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:30:42.155423 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:30:42.155440 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:30:42.467279 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:30:43.310104 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:30:43.310186 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:30:43.310246 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:30:43.310307 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:30:43.310325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:30:43.310339 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:30:43.310401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:30:43.625842 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:30:46.715038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:30:46.715144 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:30:46.715247 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:30:46.715325 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:30:46.715350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:30:46.715374 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:30:46.715447 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:30:47.023200 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:31:12.733244 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:31:12.734036 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:31:12.734167 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:31:12.734238 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:31:12.734348 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:31:12.734414 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:31:12.734434 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:31:13.039478 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:31:13.888747 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:31:13.888791 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:31:13.888882 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:31:13.888952 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:31:13.889020 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:31:13.889086 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:31:13.889155 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:31:14.194964 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:31:43.303107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:31:43.303140 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:31:43.303158 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:31:43.303214 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:31:43.303275 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:31:43.303337 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:31:43.303400 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:31:43.610519 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:31:44.464343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:31:44.464449 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:31:44.464522 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:31:44.464598 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:31:44.464614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:31:44.464635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:31:44.464722 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:31:44.772221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:31:46.842378 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:31:46.842410 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:31:46.842427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:31:46.842499 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:31:46.843513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:31:46.843826 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:31:46.844550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:31:47.154272 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:32:13.873743 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:32:13.873845 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:32:13.873866 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:32:13.873887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:32:13.873989 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:32:13.874121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:32:13.874344 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:32:14.182697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:32:15.035128 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:32:15.035238 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:32:15.035253 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:32:15.035268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:32:15.035342 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:32:15.035407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:32:15.035477 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:32:15.343332 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:32:44.440635 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:32:44.440725 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:32:44.440742 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:32:44.440759 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:32:44.440826 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:32:44.440905 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:32:44.440963 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:32:44.750978 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:32:45.603413 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:32:45.603445 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:32:45.603480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:32:45.603561 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:32:45.603649 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:32:45.603745 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:32:45.603831 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:32:45.905614 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:32:46.966666 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:32:46.966696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:32:46.966713 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:32:46.966795 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:32:46.966869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:32:46.966942 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:32:46.967012 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:32:47.275242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:33:15.017581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:33:15.017686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:33:15.017704 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:33:15.017727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:33:15.017792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:33:15.017861 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:33:15.017924 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:33:15.322237 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:33:16.166386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:33:16.166480 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:33:16.166547 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:33:16.166608 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:33:16.166672 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:33:16.166733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:33:16.166749 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:33:16.477191 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:33:45.593026 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:33:45.593138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:33:45.593202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:33:45.593263 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:33:45.593319 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:33:45.593378 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:33:45.593394 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:33:45.897203 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:33:46.739532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:33:46.739615 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:33:46.739684 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:33:46.739761 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:33:46.739778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:33:46.739793 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:33:46.739854 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:33:47.051605 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:33:47.318555 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:33:47.318631 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:33:47.318695 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:33:47.318763 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:33:47.318780 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:33:47.318798 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:33:47.318858 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:33:47.634126 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:34:16.160456 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:34:16.160489 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:34:16.160506 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:34:16.160569 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:34:16.160636 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:34:16.160697 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:34:16.160765 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:34:16.464158 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:34:17.319652 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:34:17.319684 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:34:17.319721 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:34:17.319805 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:34:17.319879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:34:17.319953 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:34:17.320026 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:34:17.621472 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:34:46.723863 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:34:46.723956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:34:46.724034 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:34:46.724128 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:34:46.724204 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:34:46.724221 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:34:46.724238 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:34:47.021926 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:34:47.274244 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:34:47.274366 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:34:47.274455 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:34:47.274538 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:34:47.274564 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:34:47.274584 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:34:47.274682 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:34:47.592815 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:34:47.884802 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:34:47.884930 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:34:47.884954 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:34:47.884977 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:34:47.885055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:34:47.885139 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:34:47.885214 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:34:48.198437 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:35:17.274371 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:35:17.274449 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:35:17.274517 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:35:17.274584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:35:17.274601 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:35:17.274616 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:35:17.274682 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:35:17.580684 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:35:18.463374 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:35:18.463405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:35:18.463426 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:35:18.463502 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:35:18.463587 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:35:18.463664 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:35:18.463750 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:35:18.767712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:35:47.355458 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:35:47.355560 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:35:47.355633 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:35:47.355704 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:35:47.355728 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:35:47.355748 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:35:47.355808 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:35:47.661431 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:35:47.930596 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:35:47.930679 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:35:47.930753 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:35:47.930822 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:35:47.930841 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:35:47.930856 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:35:47.930917 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:35:48.231590 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:35:49.026204 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:35:49.026236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:35:49.026250 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:35:49.026309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:35:49.026381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:35:49.026441 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:35:49.026503 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:35:49.334910 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:36:17.931900 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:36:17.931983 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:36:17.932006 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:36:17.932025 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:36:17.932106 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:36:17.932176 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:36:17.932246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:36:18.236477 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:36:19.597729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:36:19.598008 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:36:19.598047 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:36:19.598072 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:36:19.598610 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:36:19.598705 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:36:19.598785 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:36:19.906923 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:36:47.479001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:36:47.479084 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:36:47.479151 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:36:47.479224 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:36:47.479287 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:36:47.479303 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:36:47.479319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:36:47.793330 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:36:48.494845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:36:48.494881 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:36:48.494965 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:36:48.495029 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:36:48.495090 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:36:48.495146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:36:48.495212 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:36:48.796793 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:36:50.181222 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:36:50.181309 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:36:50.181375 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:36:50.181443 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:36:50.181460 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:36:50.181475 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:36:50.181539 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:36:50.489528 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:37:19.060609 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:37:19.060699 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:37:19.060715 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:37:19.060736 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:37:19.060802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:37:19.060862 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:37:19.060926 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:37:19.369889 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:37:20.758186 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:37:20.758270 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:37:20.758341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:37:20.758401 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:37:20.758418 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:37:20.758433 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:37:20.758502 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:37:21.065952 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:37:47.604864 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:37:47.604940 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:37:47.604961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:37:47.604974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:37:47.605042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:37:47.605108 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:37:47.605175 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:37:47.923498 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:37:49.630657 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:37:49.630745 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:37:49.630766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:37:49.630782 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:37:49.630846 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:37:49.630909 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:37:49.630969 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:37:49.939690 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:37:51.324685 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:37:51.324720 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:37:51.324801 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:37:51.324871 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:37:51.324931 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:37:51.325000 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:37:51.325060 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:37:51.628448 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:38:20.212323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:38:20.212416 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:38:20.212496 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:38:20.212584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:38:20.212603 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:38:20.212619 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:38:20.212690 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:38:20.522569 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:38:21.900263 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:38:21.900354 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:38:21.900370 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:38:21.900386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:38:21.900449 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:38:21.900517 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:38:21.900582 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:38:22.218588 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:38:47.727915 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:38:47.727994 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:38:47.728057 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:38:47.728122 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:38:47.728138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:38:47.728154 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:38:47.728219 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:38:48.034092 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:38:50.784029 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:38:50.784061 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:38:50.784156 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:38:50.784224 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:38:50.784282 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:38:50.784347 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:38:50.784411 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:38:51.090211 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:38:52.486716 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:38:52.486813 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:38:52.486838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down and a possible node drain is detected >2022-11-23 16:38:52.486854 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:38:52.486913 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:38:52.487000 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:38:52.487076 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:38:52.567070 E | op-k8sutil: timed out waiting for deployments to be updated >2022-11-23 16:38:52.567118 E | op-osd: failed to update OSD deployment "rook-ceph-osd-4": timed out waiting on deployment "rook-ceph-osd-4" >2022-11-23 16:38:52.567132 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 19 of 24 OSDs have been updated >2022-11-23 16:38:52.791176 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:38:53.668806 I | op-osd: OSD 5 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 16:38:53.673284 I | op-osd: updating OSD 5 on PVC "ocs-deviceset-1-data-0n9nmx" >2022-11-23 16:38:53.673299 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-0n9nmx" and its metadata device on "ocs-deviceset-1-metadata-0smm8c" >2022-11-23 16:38:53.673303 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-04hg6m" >2022-11-23 16:38:53.673505 I | op-osd: assigning osd 5 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 16:38:54.820389 I | op-osd: updating OSD 6 on PVC "ocs-deviceset-0-data-38bf6x" >2022-11-23 16:38:54.820409 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-38bf6x" and its metadata device on "ocs-deviceset-0-metadata-38nb58" >2022-11-23 16:38:54.820413 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-3tkdfd" >2022-11-23 16:38:54.820604 I | op-osd: assigning osd 6 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 16:39:21.355924 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:39:21.356013 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:39:21.356087 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:39:21.356109 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:39:21.356178 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:39:21.356249 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:39:21.356323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:39:21.664864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:39:23.057732 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:39:23.057818 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:39:23.057888 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:39:23.057954 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:39:23.058018 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:39:23.058036 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:39:23.058094 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:39:23.360393 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:39:47.852696 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:39:47.852817 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:39:47.852912 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:39:47.852991 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:39:47.853065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:39:47.853082 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:39:47.853156 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:39:48.154433 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:39:51.941004 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:39:51.941109 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:39:51.941177 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:39:51.941194 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:39:51.941265 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:39:51.941333 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:39:51.941406 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:39:52.269255 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:39:53.626431 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:39:53.626520 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:39:53.626591 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:39:53.626651 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:39:53.626724 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:39:53.626789 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:39:53.626857 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:39:53.928473 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:40:22.532303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:40:22.532435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:40:22.532518 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:40:22.532596 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:40:22.532680 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:40:22.532771 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:40:22.532849 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:40:22.841328 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:40:24.187321 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:40:24.187439 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:40:24.187520 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:40:24.187603 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:40:24.187682 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:40:24.187773 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:40:24.187850 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:40:24.491009 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:40:47.979845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:40:47.979879 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:40:47.979965 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:40:47.980064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:40:47.980153 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:40:47.980230 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:40:47.980302 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:40:48.284734 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:40:53.109417 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:40:53.109514 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:40:53.109534 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:40:53.109596 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:40:53.109669 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:40:53.109740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:40:53.109808 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:40:53.415351 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:40:54.755319 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:40:54.755407 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:40:54.755467 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:40:54.755528 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:40:54.755585 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:40:54.755601 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:40:54.755661 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:40:55.064513 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:41:23.679344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:41:23.679454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:41:23.679530 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:41:23.679598 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:41:23.679671 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:41:23.679771 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:41:23.679843 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:41:23.978769 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:41:25.332758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:41:25.332809 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:41:25.332895 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:41:25.332981 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:41:25.333088 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:41:25.333170 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:41:25.333252 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:41:25.641545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:41:48.106033 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:41:48.106126 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:41:48.106192 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:41:48.106260 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:41:48.106320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:41:48.106388 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:41:48.106449 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:41:48.420446 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:41:54.247907 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:41:54.247994 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:41:54.248057 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:41:54.248074 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:41:54.248139 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:41:54.248202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:41:54.248268 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:41:54.552049 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:41:55.897626 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:41:55.897709 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:41:55.897792 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:41:55.897854 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:41:55.897909 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:41:55.897971 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:41:55.897987 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:41:56.199246 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:42:24.812000 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:42:24.812101 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:42:24.812169 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:42:24.812184 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:42:24.812259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:42:24.812325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:42:24.812387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:42:25.135616 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:42:26.462085 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:42:26.462186 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:42:26.462257 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:42:26.462327 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:42:26.462385 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:42:26.462452 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:42:26.462514 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:42:26.773690 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:42:48.232847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:42:48.232882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:42:48.232956 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:42:48.233028 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:42:48.233101 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:42:48.233175 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:42:48.233249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:42:48.543137 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:42:55.395144 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:42:55.395244 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:42:55.395346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:42:55.395421 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:42:55.395504 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:42:55.395525 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:42:55.395612 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:42:55.702138 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:42:57.037216 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:42:57.037300 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:42:57.037374 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:42:57.037454 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:42:57.037528 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:42:57.037544 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:42:57.037617 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:42:57.340240 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:43:25.964745 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:43:25.964824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:43:25.964898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:43:25.964968 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:43:25.965033 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:43:25.965051 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:43:25.965111 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:43:26.269084 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:43:27.604244 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:43:27.604324 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:43:27.604349 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:43:27.604407 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:43:27.604470 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:43:27.604529 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:43:27.604594 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:43:27.906573 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:43:48.360600 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:43:48.360686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:43:48.360763 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:43:48.360781 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:43:48.360849 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:43:48.360915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:43:48.360981 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:43:48.668471 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:43:56.531449 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:43:56.531484 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:43:56.531551 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:43:56.531612 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:43:56.531673 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:43:56.531741 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:43:56.531807 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:43:56.844755 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:43:58.167862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:43:58.168490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:43:58.168577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:43:58.168598 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:43:58.168677 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:43:58.168762 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:43:58.168848 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:43:58.475351 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:44:27.106564 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:44:27.106656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:44:27.106736 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:44:27.106756 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:44:27.106829 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:44:27.106898 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:44:27.106971 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:44:27.417151 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:44:28.735250 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:44:28.735295 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:44:28.735377 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:44:28.735454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:44:28.735529 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:44:28.735621 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:44:28.735693 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:44:29.042782 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:44:48.489713 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:44:48.489802 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:44:48.489821 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:44:48.489889 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:44:48.489965 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:44:48.490033 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:44:48.490104 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:44:48.797424 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:44:57.682780 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:44:57.682864 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:44:57.682928 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:44:57.682992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:44:57.683058 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:44:57.683114 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:44:57.683130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:44:57.986412 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:44:59.316604 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:44:59.316685 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:44:59.316754 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:44:59.316825 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:44:59.316890 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:44:59.316908 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:44:59.316964 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:44:59.626498 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:45:28.246632 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:45:28.246763 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:45:28.246826 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:45:28.246889 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:45:28.246953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:45:28.246972 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:45:28.247028 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:45:28.559270 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:45:29.884468 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:45:29.884503 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:45:29.884568 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:45:29.884629 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:45:29.884692 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:45:29.884764 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:45:29.884824 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:45:30.194598 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:45:48.609824 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:45:48.609921 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:45:48.610008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:45:48.610030 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:45:48.610094 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:45:48.610163 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:45:48.610234 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:45:48.907869 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:45:58.821269 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:45:58.821345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:45:58.821407 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:45:58.821467 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:45:58.821522 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:45:58.821539 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:45:58.821597 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:45:59.130475 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:46:00.458926 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:46:00.459029 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:46:00.459090 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:46:00.459152 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:46:00.459215 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:46:00.459277 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:46:00.459335 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:46:00.764210 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:46:29.408135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:46:29.408211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:46:29.408272 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:46:29.408289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:46:29.408357 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:46:29.408416 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:46:29.408483 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:46:29.711363 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:46:31.020640 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:46:31.020723 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:46:31.021442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:46:31.021483 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:46:31.021643 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:46:31.021794 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:46:31.022104 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:46:31.324967 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:46:48.732814 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:46:48.732843 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:46:48.732908 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:46:48.732968 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:46:48.733037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:46:48.733099 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:46:48.733167 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:46:49.038918 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:46:59.974203 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:46:59.974308 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:46:59.974389 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:46:59.974463 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:46:59.974541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:46:59.974557 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:46:59.974628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:47:00.295614 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:47:01.583540 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:47:01.583646 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:47:01.583722 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:47:01.583786 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:47:01.583857 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:47:01.583873 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:47:01.583942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:47:01.888548 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:47:30.562114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:47:30.562197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:47:30.562263 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:47:30.562322 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:47:30.562387 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:47:30.562403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:47:30.562462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:47:30.864127 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:47:32.157541 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:47:32.157633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:47:32.157703 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:47:32.157766 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:47:32.157833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:47:32.157892 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:47:32.157957 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:47:32.461827 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:47:48.856587 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:47:48.856671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:47:48.856741 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:47:48.856762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:47:48.856827 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:47:48.856886 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:47:48.856951 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:47:49.159821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:48:01.127618 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:48:01.127693 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:48:01.127766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:48:01.127829 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:48:01.127903 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:48:01.127921 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:48:01.127979 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:48:01.433259 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:48:02.726885 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:48:02.726958 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:48:02.727016 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:48:02.727032 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:48:02.727094 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:48:02.727147 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:48:02.727208 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:48:03.037991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:48:31.692415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:48:31.692834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:48:31.693485 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:48:31.693517 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:48:31.693641 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:48:31.693743 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:48:31.693830 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:48:32.010121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:48:33.300386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:48:33.300496 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:48:33.300569 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:48:33.300588 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:48:33.300667 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:48:33.300757 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:48:33.300835 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:48:33.605212 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:48:48.978898 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:48:48.979008 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:48:48.979091 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:48:48.979159 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:48:48.979240 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:48:48.979307 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:48:48.979386 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:48:49.289018 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:49:02.299548 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:49:02.299662 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:49:02.299726 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:49:02.299788 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:49:02.299853 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:49:02.299870 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:49:02.299928 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:49:02.600792 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:49:03.862938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:49:03.863063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:49:03.863148 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:49:03.863169 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:49:03.863259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:49:03.863374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:49:03.863455 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:49:04.168444 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:49:32.861255 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:49:32.861337 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:49:32.861412 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:49:32.861480 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:49:32.861551 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:49:32.861614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:49:32.861632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:49:33.173702 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:49:34.431048 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:49:34.431082 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:49:34.431146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:49:34.431205 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:49:34.431272 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:49:34.431333 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:49:34.431394 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:49:34.733128 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:49:49.103622 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:49:49.103749 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:49:49.103869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:49:49.103947 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:49:49.104011 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:49:49.104072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:49:49.104139 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:49:49.415696 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:50:03.435124 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:50:03.435221 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:50:03.435283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:50:03.435348 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:50:03.435408 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:50:03.435470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:50:03.435535 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:50:03.742716 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:50:04.998096 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:50:04.998177 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:50:04.998250 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:50:04.998268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:50:04.998329 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:50:04.998394 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:50:04.998453 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:50:05.308898 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:50:34.000599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:50:34.000632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:50:34.000721 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:50:34.000782 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:50:34.000842 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:50:34.000902 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:50:34.000960 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:50:34.316639 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:50:35.572526 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:50:35.572601 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:50:35.572667 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:50:35.572732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:50:35.572796 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:50:35.572813 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:50:35.572875 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:50:35.881449 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:50:49.228566 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:50:49.228639 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:50:49.228699 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:50:49.228773 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:50:49.228838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:50:49.228857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:50:49.228914 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:50:49.534225 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:51:04.579742 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:51:04.579814 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:51:04.579872 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:51:04.579889 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:51:04.579955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:51:04.580753 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:51:04.581008 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:51:04.889184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:51:06.137323 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:51:06.137417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:51:06.137483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:51:06.137554 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:51:06.137620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:51:06.137680 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:51:06.137748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:51:06.442067 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:51:35.150670 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:51:35.150762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:51:35.150822 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:51:35.150875 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:51:35.150951 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:51:35.150967 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:51:35.151033 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:51:35.457622 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:51:36.707835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:51:36.707933 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:51:36.707950 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:51:36.708014 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:51:36.708077 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:51:36.708140 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:51:36.708201 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:51:37.013228 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:51:49.352996 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:51:49.353088 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:51:49.353160 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:51:49.353178 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:51:49.353257 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:51:49.353330 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:51:49.353408 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:51:49.653207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:52:05.716997 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:52:05.717113 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:52:05.717186 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:52:05.717241 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:52:05.717305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:52:05.717374 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:52:05.717393 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:52:06.024409 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:52:07.272059 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:52:07.272165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:52:07.272188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:52:07.272275 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:52:07.272358 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:52:07.272433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:52:07.272511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:52:07.573672 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:52:36.284987 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:52:36.285088 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:52:36.285166 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:52:36.285184 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:52:36.285254 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:52:36.285320 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:52:36.285394 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:52:36.600621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:52:37.839466 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:52:37.839549 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:52:37.839609 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:52:37.839681 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:52:37.839748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:52:37.839764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:52:37.839838 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:52:38.145459 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:52:49.471184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:52:49.471262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:52:49.471328 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:52:49.471348 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:52:49.471416 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:52:49.471483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:52:49.471551 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:52:49.778512 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:53:06.859204 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:53:06.859242 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:53:06.859337 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:53:06.859411 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:53:06.859487 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:53:06.859551 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:53:06.859617 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:53:07.166846 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:53:08.400132 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:53:08.400254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:53:08.400278 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:53:08.400342 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:53:08.400405 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:53:08.400470 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:53:08.400533 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:53:08.713790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:53:37.429997 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:53:37.430096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:53:37.430160 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:53:37.430221 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:53:37.430279 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:53:37.430336 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:53:37.430352 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:53:37.734677 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:53:38.983917 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:53:38.983992 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:53:38.984050 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:53:38.984109 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:53:38.984161 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:53:38.984178 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:53:38.984249 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:53:39.301084 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:53:49.589556 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:53:49.589635 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:53:49.589662 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:53:49.589727 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:53:49.589797 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:53:49.589857 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:53:49.589920 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:53:49.899626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:54:07.994688 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:54:07.994806 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:54:07.994889 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:54:07.994956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:54:07.995018 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:54:07.995072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:54:07.995135 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:54:08.300387 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:54:09.566155 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:54:09.566233 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:54:09.566296 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:54:09.566361 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:54:09.566423 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:54:09.566439 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:54:09.566515 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:54:09.879730 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:54:38.559943 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:54:38.560022 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:54:38.560095 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:54:38.560111 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:54:38.560170 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:54:38.560235 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:54:38.560298 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:54:38.866012 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:54:40.150847 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:54:40.150933 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:54:40.150953 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:54:40.151011 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:54:40.151074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:54:40.151129 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:54:40.151189 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:54:40.459231 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:54:49.717539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:54:49.718022 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:54:49.718117 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:54:49.718140 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:54:49.718208 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:54:49.718272 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:54:49.718339 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:54:50.029110 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:55:09.128739 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:55:09.128833 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:55:09.128851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:55:09.128914 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:55:09.128977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:55:09.129039 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:55:09.129102 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:55:09.441806 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:55:10.721462 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:55:10.721536 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:55:10.721604 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:55:10.721676 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:55:10.721742 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:55:10.721762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:55:10.721818 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:55:11.028066 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:55:39.706870 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:55:39.706952 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:55:39.707023 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:55:39.707093 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:55:39.707146 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:55:39.707163 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:55:39.707220 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:55:40.018231 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:55:41.295936 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:55:41.295968 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:55:41.296029 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:55:41.296094 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:55:41.296149 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:55:41.296216 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:55:41.296275 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:55:41.601269 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:55:49.838253 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:55:49.838348 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:55:49.838429 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:55:49.838501 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:55:49.838558 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:55:49.838575 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:55:49.838655 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:55:50.154882 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:56:10.280872 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:56:10.280906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:56:10.280965 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:56:10.281029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:56:10.281089 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:56:10.281154 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:56:10.281214 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:56:10.600146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:56:11.874167 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:56:11.874250 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:56:11.874316 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:56:11.874334 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:56:11.874396 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:56:11.874456 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:56:11.874526 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:56:12.194088 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:56:40.871715 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:56:40.871817 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:56:40.871884 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:56:40.871958 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:56:40.872033 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:56:40.872088 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:56:40.872145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:56:41.176926 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:56:42.455885 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:56:42.455991 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:56:42.456010 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:56:42.456079 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:56:42.456137 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:56:42.456197 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:56:42.456255 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:56:42.760609 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:56:49.958746 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:56:49.958778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:56:49.958840 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:56:49.958905 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:56:49.958962 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:56:49.959022 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:56:49.959081 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:56:50.277872 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:57:11.441645 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:57:11.441732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:57:11.441794 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:57:11.441811 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:57:11.441871 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:57:11.441933 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:57:11.441996 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:57:11.751644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:57:13.023630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:57:13.023709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:57:13.023737 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:57:13.023799 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:57:13.023865 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:57:13.023924 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:57:13.023988 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:57:13.329960 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:57:42.014185 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:57:42.014287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:57:42.014365 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:57:42.014450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:57:42.014525 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:57:42.014544 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:57:42.014623 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:57:42.334614 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:57:43.589411 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:57:43.589496 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:57:43.589517 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:57:43.589596 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:57:43.589673 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:57:43.589776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:57:43.589857 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:57:43.897073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:57:50.085755 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:57:50.085866 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:57:50.085946 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:57:50.086027 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:57:50.086107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:57:50.086187 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:57:50.086211 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:57:50.390412 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:58:12.597159 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:58:12.597252 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:58:12.597273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:58:12.597340 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:58:12.597409 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:58:12.597471 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:58:12.597529 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:58:12.904837 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:58:14.152902 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:58:14.153028 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:58:14.153090 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:58:14.153153 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:58:14.153231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:58:14.153300 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:58:14.153360 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:58:14.458856 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:58:43.180795 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:58:43.180920 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:58:43.180992 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:58:43.181012 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:58:43.181084 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:58:43.181158 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:58:43.181266 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:58:43.493802 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:58:44.723115 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:58:44.723197 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:58:44.723256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:58:44.723275 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:58:44.723353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:58:44.723415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:58:44.723480 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:58:45.032130 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:58:50.207595 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down and a possible node drain is detected >2022-11-23 16:58:50.207683 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:58:50.207758 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:58:50.207819 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:58:50.207880 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:58:50.207942 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:58:50.208003 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:58:50.515684 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:58:54.874425 E | op-k8sutil: timed out waiting for deployments to be updated >2022-11-23 16:58:54.874468 E | op-osd: failed to update OSD deployment "rook-ceph-osd-6": timed out waiting on deployment "rook-ceph-osd-6" >2022-11-23 16:58:54.874478 I | op-osd: restarting watcher for OSD provisioning status ConfigMaps. the watcher closed the channel >2022-11-23 16:58:54.877564 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 21 of 24 OSDs have been updated >2022-11-23 16:58:55.984528 I | op-osd: OSD 7 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 16:58:55.988899 I | op-osd: updating OSD 7 on PVC "ocs-deviceset-1-data-39vw7k" >2022-11-23 16:58:55.988920 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-39vw7k" and its metadata device on "ocs-deviceset-1-metadata-3b5jhh" >2022-11-23 16:58:55.988924 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-3rjmpt" >2022-11-23 16:58:55.989146 I | op-osd: assigning osd 7 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 16:58:57.124309 I | op-osd: updating OSD 8 on PVC "ocs-deviceset-0-data-6gm2pc" >2022-11-23 16:58:57.124328 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-6gm2pc" and its metadata device on "ocs-deviceset-0-metadata-6f4z9s" >2022-11-23 16:58:57.124332 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-65gnbk" >2022-11-23 16:58:57.124512 I | op-osd: assigning osd 8 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 16:59:13.758392 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:59:13.758473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 16:59:13.758537 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:59:13.758605 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:59:13.758671 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:59:13.758745 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:59:13.758814 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:59:14.069085 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:59:15.295349 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:59:15.295423 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:59:15.295490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 16:59:15.295550 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:59:15.295607 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:59:15.295664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:59:15.295724 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:59:15.608497 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:59:44.334851 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:59:44.334930 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:59:44.334994 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:59:44.335055 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:59:44.335117 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:59:44.335181 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 16:59:44.335253 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:59:44.640992 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:59:45.866412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:59:45.866490 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:59:45.866556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:59:45.866616 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:59:45.866680 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:59:45.866750 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:59:45.866810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 16:59:46.179435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 16:59:50.334175 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 16:59:50.334276 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 16:59:50.334356 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 16:59:50.334432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 16:59:50.335379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 16:59:50.335942 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 16:59:50.336606 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 16:59:50.643847 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:00:14.902024 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:00:14.902114 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:00:14.902184 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:00:14.902243 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:00:14.902307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:00:14.902374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:00:14.902436 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:00:15.214734 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:00:16.438301 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:00:16.438388 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:00:16.438455 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:00:16.438516 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:00:16.438577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:00:16.438642 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:00:16.438715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:00:16.739204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:00:45.470862 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:00:45.470957 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:00:45.471019 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:00:45.471087 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:00:45.471150 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:00:45.471214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:00:45.471282 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:00:45.775673 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:00:47.002346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:00:47.002431 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:00:47.002509 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:00:47.002569 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:00:47.002641 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:00:47.002698 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:00:47.002771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:00:47.310145 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:00:50.457196 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:00:50.457282 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:00:50.457346 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:00:50.457406 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:00:50.457475 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:00:50.457533 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:00:50.457595 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:00:50.769653 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:01:16.040147 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:01:16.040234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:01:16.040315 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:01:16.040380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:01:16.040446 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:01:16.040501 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:01:16.040562 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:01:16.349313 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:01:17.568722 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:01:17.568799 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:01:17.568870 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:01:17.568940 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:01:17.568999 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:01:17.569059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:01:17.569121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:01:17.878747 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:01:46.613882 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:01:46.613973 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:01:46.614030 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:01:46.614093 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:01:46.614161 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:01:46.614222 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:01:46.614278 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:01:46.926037 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:01:48.138903 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:01:48.138985 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:01:48.139053 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:01:48.139118 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:01:48.139180 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:01:48.139242 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:01:48.139308 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:01:48.444444 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:01:50.577146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:01:50.577223 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:01:50.577283 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:01:50.577343 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:01:50.577405 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:01:50.577459 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:01:50.577522 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:01:50.895180 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:02:17.189278 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:02:17.189361 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:02:17.189422 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:02:17.189483 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:02:17.189541 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:02:17.189600 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:02:17.189657 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:02:17.490049 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:02:18.706928 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:02:18.707008 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:02:18.707068 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:02:18.707154 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:02:18.707213 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:02:18.707274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:02:18.707339 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:02:19.014139 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:02:47.753688 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:02:47.753768 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:02:47.753833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:02:47.753896 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:02:47.753958 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:02:47.754018 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:02:47.754085 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:02:48.062935 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:02:49.285298 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:02:49.285381 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:02:49.285453 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:02:49.285513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:02:49.285579 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:02:49.285637 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:02:49.285699 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:02:49.595892 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:02:50.703470 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:02:50.703547 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:02:50.703614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:02:50.703673 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:02:50.703742 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:02:50.703803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:02:50.703860 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:02:51.016043 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:03:18.324067 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:03:18.324154 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:03:18.324220 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:03:18.324302 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:03:18.324365 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:03:18.324447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:03:18.324514 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:03:18.630979 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:03:19.854076 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:03:19.854180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:03:19.854257 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:03:19.854338 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:03:19.854405 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:03:19.854479 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:03:19.854548 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:03:20.174724 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:03:48.893977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:03:48.894079 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:03:48.894164 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:03:48.894242 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:03:48.894309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:03:48.894379 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:03:48.894445 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:03:49.232517 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:03:50.438407 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:03:50.438511 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:03:50.438585 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:03:50.438663 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:03:50.438749 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:03:50.438821 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:03:50.438901 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:03:50.746644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:03:51.012158 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:03:51.012233 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:03:51.012303 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:03:51.012361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:03:51.012418 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:03:51.012479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:03:51.012541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:03:51.314131 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:04:19.495818 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:04:19.496233 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:04:19.496817 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:04:19.497272 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:04:19.498611 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:04:19.498725 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:04:19.498810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:04:19.807334 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:04:21.013147 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:04:21.013229 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:04:21.013304 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:04:21.013369 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:04:21.013432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:04:21.013503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:04:21.013581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:04:21.315997 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:04:50.087683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:04:50.087771 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:04:50.087850 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:04:50.087915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:04:50.087975 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:04:50.088042 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:04:50.088102 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:04:50.392589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:04:50.941832 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:04:50.941943 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:04:50.942015 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:04:50.942078 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:04:50.942142 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:04:50.942196 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:04:50.942262 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:04:51.248510 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:04:51.575546 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:04:51.575649 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:04:51.575708 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:04:51.575781 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:04:51.575836 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:04:51.575905 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:04:51.575969 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:04:51.882354 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:05:20.656870 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:05:20.656982 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:05:20.657046 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:05:20.657106 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:05:20.657170 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:05:20.657227 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:05:20.657283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:05:20.962516 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:05:22.152406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:05:22.152498 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:05:22.152556 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:05:22.152639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:05:22.152702 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:05:22.152769 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:05:22.152827 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:05:22.453748 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:05:51.069012 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:05:51.069091 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:05:51.069152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:05:51.069221 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:05:51.069281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:05:51.069345 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:05:51.069409 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:05:51.375640 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:05:51.631950 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:05:51.632025 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:05:51.632087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:05:51.632151 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:05:51.632217 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:05:51.632277 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:05:51.632341 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:05:51.944280 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:05:52.716204 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:05:52.716315 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:05:52.716379 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:05:52.716443 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:05:52.716504 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:05:52.716559 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:05:52.716621 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:05:53.034568 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:06:21.632650 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:06:21.632745 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:06:21.632816 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:06:21.632883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:06:21.632959 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:06:21.633032 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:06:21.633092 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:06:21.947745 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:06:23.299844 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:06:23.299926 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:06:23.300001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:06:23.300063 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:06:23.300120 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:06:23.300182 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:06:23.300247 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:06:23.601132 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:06:51.191280 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:06:51.191358 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:06:51.191425 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:06:51.191491 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:06:51.191551 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:06:51.191611 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:06:51.191681 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:06:51.497547 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:06:52.238715 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:06:52.238810 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:06:52.238885 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:06:52.238947 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:06:52.239010 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:06:52.239070 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:06:52.239133 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:06:52.552440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:06:53.864897 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:06:53.864991 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:06:53.865073 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:06:53.865153 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:06:53.865231 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:06:53.865307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:06:53.865385 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:06:54.171927 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:07:22.819364 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:07:22.819453 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:07:22.819529 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:07:22.819618 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:07:22.819700 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:07:22.819781 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:07:22.819859 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:07:23.116602 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:07:24.440315 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:07:24.441228 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:07:24.441753 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:07:24.442246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:07:24.442325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:07:24.442401 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:07:24.442512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:07:24.754954 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:07:51.314424 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:07:51.314523 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:07:51.314607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:07:51.314686 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:07:51.314774 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:07:51.314851 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:07:51.314937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:07:51.615926 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:07:53.375325 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:07:53.375418 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:07:53.375489 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:07:53.375563 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:07:53.375628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:07:53.375694 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:07:53.375765 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:07:53.686368 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:07:55.020446 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:07:55.020557 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:07:55.020642 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:07:55.020739 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:07:55.020816 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:07:55.020895 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:07:55.020969 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:07:55.350601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:08:23.963249 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:08:23.963339 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:08:23.963415 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:08:23.963488 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:08:23.963561 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:08:23.963624 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:08:23.963690 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:08:24.274141 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:08:25.614857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:08:25.614942 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:08:25.615012 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:08:25.615081 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:08:25.615142 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:08:25.615208 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:08:25.615272 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:08:25.919765 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:08:51.440123 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:08:51.440211 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:08:51.440317 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:08:51.440389 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:08:51.440470 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:08:51.440562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:08:51.440628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:08:51.748457 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:08:54.536521 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:08:54.536630 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:08:54.536703 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:08:54.536784 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:08:54.536844 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:08:54.536912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:08:54.536973 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:08:54.845535 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:08:56.184570 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:08:56.184655 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:08:56.184737 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:08:56.184810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:08:56.184874 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:08:56.184936 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:08:56.184994 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:08:56.496311 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:09:25.137225 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:09:25.137310 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:09:25.137371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:09:25.137439 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:09:25.137501 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:09:25.137563 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:09:25.137637 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:09:25.447008 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:09:26.757476 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:09:26.757577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:09:26.757647 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:09:26.757713 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:09:26.757785 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:09:26.757854 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:09:26.757923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:09:27.063548 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:09:51.564790 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:09:51.564870 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:09:51.564942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:09:51.565004 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:09:51.565063 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:09:51.565132 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:09:51.565196 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:09:51.873569 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:09:55.713916 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:09:55.714013 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:09:55.714073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:09:55.714148 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:09:55.714206 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:09:55.714269 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:09:55.714326 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:09:56.021408 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:09:57.327965 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:09:57.328079 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:09:57.328164 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:09:57.328241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:09:57.328310 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:09:57.328386 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:09:57.328467 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:09:57.638281 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:10:26.285546 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:10:26.285665 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:10:26.285752 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:10:26.285829 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:10:26.285911 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:10:26.285987 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:10:26.286067 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:10:26.596820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:10:27.902197 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:10:27.902286 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:10:27.902355 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:10:27.902428 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:10:27.902497 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:10:27.902564 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:10:27.902637 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:10:28.211443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:10:51.687219 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:10:51.687332 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:10:51.687408 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:10:51.687490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:10:51.687567 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:10:51.687650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:10:51.687739 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:10:51.996636 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:10:56.858250 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:10:56.858339 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:10:56.858410 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:10:56.858481 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:10:56.858547 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:10:56.858604 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:10:56.858677 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:10:57.165455 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:10:58.474650 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:10:58.474734 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:10:58.474802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:10:58.474860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:10:58.474923 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:10:58.474982 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:10:58.475046 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:10:58.785351 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:11:27.429606 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:11:27.429701 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:11:27.429772 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:11:27.429837 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:11:27.429904 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:11:27.429965 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:11:27.430030 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:11:27.731549 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:11:29.055289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:11:29.055394 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:11:29.055474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:11:29.055548 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:11:29.055623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:11:29.055695 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:11:29.055771 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:11:29.372535 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:11:51.814867 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:11:51.814988 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:11:51.815059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:11:51.815132 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:11:51.815201 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:11:51.815272 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:11:51.815333 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:11:52.124338 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:11:57.996250 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:11:57.996359 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:11:57.996424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:11:57.996490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:11:57.996549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:11:57.996611 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:11:57.996673 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:11:58.301182 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:11:59.634603 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:11:59.634677 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:11:59.634768 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:11:59.634830 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:11:59.634891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:11:59.634951 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:11:59.635010 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:11:59.939827 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:12:28.566023 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:12:28.566099 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:12:28.566159 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:12:28.566230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:12:28.566290 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:12:28.566354 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:12:28.566410 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:12:28.878654 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:12:30.206407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:12:30.206508 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:12:30.206614 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:12:30.206734 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:12:30.206812 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:12:30.206897 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:12:30.206967 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:12:30.513344 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:12:51.936140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:12:51.936219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:12:51.936292 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:12:51.936360 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:12:51.936429 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:12:51.936491 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:12:51.936554 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:12:52.251063 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:12:59.137431 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:12:59.137528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:12:59.137596 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:12:59.137658 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:12:59.137724 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:12:59.137784 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:12:59.137845 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:12:59.459700 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:13:00.774067 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:13:00.774155 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:13:00.774222 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:13:00.774287 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:13:00.774344 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:13:00.774411 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:13:00.774474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:13:01.076413 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:13:29.731993 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:13:29.732077 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:13:29.732151 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:13:29.732219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:13:29.732281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:13:29.732352 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:13:29.732418 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:13:30.045336 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:13:31.334281 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:13:31.334363 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:13:31.334435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:13:31.334499 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:13:31.334564 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:13:31.334621 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:13:31.334684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:13:31.645043 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:13:52.057955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:13:52.058042 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:13:52.058107 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:13:52.058175 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:13:52.058238 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:13:52.058305 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:13:52.058367 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:13:52.386684 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:14:00.320204 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:14:00.320313 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:14:00.320397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:14:00.320475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:14:00.320547 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:14:00.320621 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:14:00.320691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:14:00.620388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:14:01.913403 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:14:01.913490 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:14:01.913571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:14:01.913647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:14:01.913723 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:14:01.913793 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:14:01.913865 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:14:02.221107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:14:30.876067 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:14:30.876144 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:14:30.876213 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:14:30.876279 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:14:30.876348 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:14:30.876406 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:14:30.876464 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:14:31.176983 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:14:32.486579 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:14:32.486681 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:14:32.486748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:14:32.486811 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:14:32.486884 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:14:32.486945 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:14:32.487004 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:14:32.786752 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:14:52.181816 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:14:52.181892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:14:52.181950 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:14:52.182025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:14:52.182082 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:14:52.182149 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:14:52.182208 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:14:52.492019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:15:01.441192 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:15:01.441577 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:15:01.442348 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:15:01.442434 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:15:01.442508 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:15:01.442655 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:15:01.442733 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:15:01.753371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:15:03.051668 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:15:03.051794 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:15:03.051867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:15:03.051955 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:15:03.052029 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:15:03.052108 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:15:03.052184 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:15:03.362521 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:15:32.015316 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:15:32.015424 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:15:32.015496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:15:32.015578 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:15:32.015655 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:15:32.015736 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:15:32.015811 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:15:32.333014 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:15:33.628369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:15:33.628478 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:15:33.628550 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:15:33.628623 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:15:33.628699 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:15:33.628779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:15:33.628851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:15:33.931962 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:15:52.312727 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:15:52.312811 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:15:52.312885 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:15:52.312963 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:15:52.313033 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:15:52.313099 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:15:52.313162 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:15:52.621770 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:16:02.599073 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:16:02.599163 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:16:02.599233 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:16:02.599302 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:16:02.599366 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:16:02.599438 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:16:02.599504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:16:02.913520 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:16:04.195014 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:16:04.195094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:16:04.195160 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:16:04.195229 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:16:04.195293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:16:04.195353 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:16:04.195414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:16:04.509733 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:16:33.174041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:16:33.174148 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:16:33.174214 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:16:33.174285 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:16:33.174347 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:16:33.174412 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:16:33.174476 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:16:33.483155 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:16:34.775890 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:16:34.775986 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:16:34.776067 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:16:34.776147 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:16:34.776248 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:16:34.776328 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:16:34.776404 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:16:35.086810 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:16:52.446499 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:16:52.446580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:16:52.446670 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:16:52.446750 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:16:52.446823 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:16:52.446910 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:16:52.446981 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:16:52.755418 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:17:03.747262 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:17:03.747365 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:17:03.747427 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:17:03.747496 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:17:03.747556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:17:03.747620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:17:03.747692 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:17:04.053200 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:17:05.344898 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:17:05.344977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:17:05.345045 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:17:05.345114 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:17:05.345180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:17:05.345241 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:17:05.345306 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:17:05.659977 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:17:34.322335 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:17:34.322458 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:17:34.322531 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:17:34.322615 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:17:34.322684 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:17:34.322767 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:17:34.322858 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:17:34.631384 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:17:35.924792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:17:35.924881 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:17:35.924939 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:17:35.924999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:17:35.925070 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:17:35.925138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:17:35.925203 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:17:36.234429 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:17:52.575704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:17:52.575811 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:17:52.575884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:17:52.575968 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:17:52.576053 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:17:52.576131 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:17:52.576209 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:17:52.890248 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:18:04.891136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:18:04.891229 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:18:04.891293 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:18:04.891363 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:18:04.891451 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:18:04.891537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:18:04.891625 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:18:05.197512 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:18:06.493561 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:18:06.493664 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:18:06.493738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:18:06.494874 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:18:06.495193 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:18:06.495794 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:18:06.496216 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:18:06.803260 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:18:35.459805 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:18:35.459916 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:18:35.459985 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:18:35.460058 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:18:35.460120 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:18:35.460189 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:18:35.460251 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:18:35.768312 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:18:37.064796 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:18:37.064913 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:18:37.064992 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:18:37.065068 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:18:37.065149 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:18:37.065222 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:18:37.065300 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:18:37.364962 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:18:52.706541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:18:52.706639 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:18:52.706705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:18:52.706776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:18:52.706850 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:18:52.706925 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:18:52.707004 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:18:53.012654 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:18:57.180240 E | op-k8sutil: timed out waiting for deployments to be updated >2022-11-23 17:18:57.180288 E | op-osd: failed to update OSD deployment "rook-ceph-osd-8": timed out waiting on deployment "rook-ceph-osd-8" >2022-11-23 17:18:57.180300 I | op-osd: waiting... 0 of 0 OSD prepare jobs have finished processing and 23 of 24 OSDs have been updated >2022-11-23 17:18:58.265943 I | op-osd: OSD 9 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:18:58.270350 I | op-osd: updating OSD 9 on PVC "ocs-deviceset-1-data-1sjmbp" >2022-11-23 17:18:58.270368 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-1sjmbp" and its metadata device on "ocs-deviceset-1-metadata-1nkrbj" >2022-11-23 17:18:58.270374 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-14wj6w" >2022-11-23 17:18:58.270579 I | op-osd: assigning osd 9 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 17:18:58.365752 E | ceph-cluster-controller: failed to reconcile CephCluster "openshift-storage/ocs-storagecluster-cephcluster". failed to reconcile cluster "ocs-storagecluster-cephcluster": failed to configure local ceph cluster: failed to create cluster: failed to start ceph osds: 7 failures encountered while running osds on nodes in namespace "openshift-storage". >failed to update OSD deployment "rook-ceph-osd-11": timed out waiting on deployment "rook-ceph-osd-11" >failed to update OSD deployment "rook-ceph-osd-13": timed out waiting on deployment "rook-ceph-osd-13" >failed to update OSD deployment "rook-ceph-osd-15": timed out waiting on deployment "rook-ceph-osd-15" >failed to update OSD deployment "rook-ceph-osd-19": timed out waiting on deployment "rook-ceph-osd-19" >failed to update OSD deployment "rook-ceph-osd-4": timed out waiting on deployment "rook-ceph-osd-4" >failed to update OSD deployment "rook-ceph-osd-6": timed out waiting on deployment "rook-ceph-osd-6" >failed to update OSD deployment "rook-ceph-osd-8": timed out waiting on deployment "rook-ceph-osd-8" >2022-11-23 17:18:58.376250 I | ceph-cluster-controller: reconciling ceph cluster in namespace "openshift-storage" >2022-11-23 17:18:58.380972 I | ceph-spec: parsing mon endpoints: b=172.30.188.21:6789,c=172.30.33.66:6789,a=172.30.219.163:6789 >2022-11-23 17:18:58.425736 I | ceph-spec: detecting the ceph image version for image registry.redhat.io/rhceph/rhceph-5-rhel8@sha256:7892e9da0a70b2d7e3efd98d2cb980e485f07eddff6a0dac6d6bd6c516914f3c... >2022-11-23 17:19:02.396066 I | ceph-spec: detected ceph image version: "16.2.8-84 pacific" >2022-11-23 17:19:02.396083 I | ceph-cluster-controller: validating ceph version from provided image >2022-11-23 17:19:02.399330 I | ceph-spec: parsing mon endpoints: b=172.30.188.21:6789,c=172.30.33.66:6789,a=172.30.219.163:6789 >2022-11-23 17:19:02.401002 I | cephclient: writing config file /var/lib/rook/openshift-storage/openshift-storage.config >2022-11-23 17:19:02.401107 I | cephclient: generated admin config in /var/lib/rook/openshift-storage >2022-11-23 17:19:02.703709 I | ceph-cluster-controller: cluster "openshift-storage": version "16.2.8-84 pacific" detected for image "registry.redhat.io/rhceph/rhceph-5-rhel8@sha256:7892e9da0a70b2d7e3efd98d2cb980e485f07eddff6a0dac6d6bd6c516914f3c" >2022-11-23 17:19:02.757576 I | op-mon: start running mons >2022-11-23 17:19:02.762444 I | ceph-spec: parsing mon endpoints: b=172.30.188.21:6789,c=172.30.33.66:6789,a=172.30.219.163:6789 >2022-11-23 17:19:02.990502 I | op-mon: saved mon endpoints to config map map[csi-cluster-config-json:[{"clusterID":"openshift-storage","monitors":["172.30.188.21:6789","172.30.33.66:6789","172.30.219.163:6789"],"namespace":""}] data:b=172.30.188.21:6789,c=172.30.33.66:6789,a=172.30.219.163:6789 mapping:{"node":{"a":null,"b":null,"c":null}} maxMonId:2] >2022-11-23 17:19:03.588871 I | cephclient: writing config file /var/lib/rook/openshift-storage/openshift-storage.config >2022-11-23 17:19:03.588980 I | cephclient: generated admin config in /var/lib/rook/openshift-storage >2022-11-23 17:19:05.188736 I | op-mon: targeting the mon count 3 >2022-11-23 17:19:05.199333 I | op-config: setting "global"="mon allow pool delete"="true" option to the mon configuration database >2022-11-23 17:19:05.457226 I | op-config: successfully set "global"="mon allow pool delete"="true" option to the mon configuration database >2022-11-23 17:19:05.457245 I | op-config: setting "global"="mon cluster log file"="" option to the mon configuration database >2022-11-23 17:19:05.708155 I | op-config: successfully set "global"="mon cluster log file"="" option to the mon configuration database >2022-11-23 17:19:05.708175 I | op-config: setting "global"="mon allow pool size one"="true" option to the mon configuration database >2022-11-23 17:19:05.958866 I | op-config: successfully set "global"="mon allow pool size one"="true" option to the mon configuration database >2022-11-23 17:19:05.958887 I | op-config: setting "global"="osd scrub auto repair"="true" option to the mon configuration database >2022-11-23 17:19:06.024279 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:19:06.024482 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:19:06.024739 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:19:06.025145 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:19:06.025650 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:19:06.026619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:19:06.026727 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:19:06.209262 I | op-config: successfully set "global"="osd scrub auto repair"="true" option to the mon configuration database >2022-11-23 17:19:06.209283 I | op-config: setting "global"="log to file"="true" option to the mon configuration database >2022-11-23 17:19:06.332955 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:19:06.460504 I | op-config: successfully set "global"="log to file"="true" option to the mon configuration database >2022-11-23 17:19:06.460526 I | op-config: deleting "log file" option from the mon configuration database >2022-11-23 17:19:06.708231 I | op-config: successfully deleted "log file" option from the mon configuration database >2022-11-23 17:19:06.708249 I | op-mon: checking for basic quorum with existing mons >2022-11-23 17:19:06.726915 I | op-mon: mon "b" ip is 172.30.188.21 >2022-11-23 17:19:06.789603 I | op-mon: mon "c" ip is 172.30.33.66 >2022-11-23 17:19:07.590405 I | op-mon: mon "a" ip is 172.30.219.163 >2022-11-23 17:19:07.624544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:19:07.624624 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:19:07.624698 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:19:07.624766 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:19:07.624845 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:19:07.624913 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:19:07.624974 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:19:07.926881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:19:08.188752 I | op-mon: saved mon endpoints to config map map[csi-cluster-config-json:[{"clusterID":"openshift-storage","monitors":["172.30.188.21:6789","172.30.33.66:6789","172.30.219.163:6789"],"namespace":""}] data:b=172.30.188.21:6789,c=172.30.33.66:6789,a=172.30.219.163:6789 mapping:{"node":{"a":null,"b":null,"c":null}} maxMonId:2] >2022-11-23 17:19:08.789217 I | cephclient: writing config file /var/lib/rook/openshift-storage/openshift-storage.config >2022-11-23 17:19:08.789305 I | cephclient: generated admin config in /var/lib/rook/openshift-storage >2022-11-23 17:19:09.388806 I | op-mon: deployment for mon rook-ceph-mon-b already exists. updating if needed >2022-11-23 17:19:09.395123 I | op-k8sutil: deployment "rook-ceph-mon-b" did not change, nothing to update >2022-11-23 17:19:09.395139 I | op-mon: waiting for mon quorum with [b c a] >2022-11-23 17:19:09.999061 I | op-mon: mons running: [b c a] >2022-11-23 17:19:10.315274 I | op-mon: Monitors in quorum: [a b c] >2022-11-23 17:19:10.321341 I | op-mon: deployment for mon rook-ceph-mon-c already exists. updating if needed >2022-11-23 17:19:10.327009 I | op-k8sutil: deployment "rook-ceph-mon-c" did not change, nothing to update >2022-11-23 17:19:10.327023 I | op-mon: waiting for mon quorum with [b c a] >2022-11-23 17:19:10.799194 I | op-mon: mons running: [b c a] >2022-11-23 17:19:11.105677 I | op-mon: Monitors in quorum: [a b c] >2022-11-23 17:19:11.112360 I | op-mon: deployment for mon rook-ceph-mon-a already exists. updating if needed >2022-11-23 17:19:11.118911 I | op-k8sutil: deployment "rook-ceph-mon-a" did not change, nothing to update >2022-11-23 17:19:11.118925 I | op-mon: waiting for mon quorum with [b c a] >2022-11-23 17:19:11.597803 I | op-mon: mons running: [b c a] >2022-11-23 17:19:11.902657 I | op-mon: Monitors in quorum: [a b c] >2022-11-23 17:19:11.902677 I | op-mon: mons created: 3 >2022-11-23 17:19:12.227025 I | op-mon: waiting for mon quorum with [b c a] >2022-11-23 17:19:12.267208 I | op-mon: mons running: [b c a] >2022-11-23 17:19:12.574605 I | op-mon: Monitors in quorum: [a b c] >2022-11-23 17:19:12.575838 I | op-mon: checking for orphaned mon resources >2022-11-23 17:19:12.924930 I | cephclient: getting or creating ceph auth key "client.csi-rbd-provisioner" >2022-11-23 17:19:13.241568 I | cephclient: getting or creating ceph auth key "client.csi-rbd-node" >2022-11-23 17:19:13.554476 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-provisioner" >2022-11-23 17:19:13.866319 I | cephclient: getting or creating ceph auth key "client.csi-cephfs-node" >2022-11-23 17:19:14.208058 I | ceph-csi: created kubernetes csi secrets for cluster "openshift-storage" >2022-11-23 17:19:14.208077 I | cephclient: getting or creating ceph auth key "client.crash" >2022-11-23 17:19:14.527492 I | ceph-crashcollector-controller: created kubernetes crash collector secret for cluster "openshift-storage" >2022-11-23 17:19:14.527509 I | op-config: deleting "mon_mds_skip_sanity" option from the mon configuration database >2022-11-23 17:19:14.781866 I | op-config: successfully deleted "mon_mds_skip_sanity" option from the mon configuration database >2022-11-23 17:19:14.781886 I | cephclient: create rbd-mirror bootstrap peer token "client.rbd-mirror-peer" >2022-11-23 17:19:14.781889 I | cephclient: getting or creating ceph auth key "client.rbd-mirror-peer" >2022-11-23 17:19:15.090918 I | cephclient: successfully created rbd-mirror bootstrap peer token for cluster "ocs-storagecluster-cephcluster" >2022-11-23 17:19:15.121600 I | op-mgr: start running mgr >2022-11-23 17:19:15.121616 I | cephclient: getting or creating ceph auth key "mgr.a" >2022-11-23 17:19:15.442543 I | op-mgr: deployment for mgr rook-ceph-mgr-a already exists. updating if needed >2022-11-23 17:19:15.450591 I | op-k8sutil: deployment "rook-ceph-mgr-a" did not change, nothing to update >2022-11-23 17:19:15.454470 I | op-mgr: setting services to point to mgr "a" >W1123 17:19:16.190936 1 client_config.go:617] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work. >2022-11-23 17:19:16.389826 I | op-mgr: no need to update service "rook-ceph-mgr" >2022-11-23 17:19:16.389930 I | op-mgr: successful modules: balancer >2022-11-23 17:19:16.404839 I | op-osd: start running osds in namespace "openshift-storage" >2022-11-23 17:19:16.404849 I | op-osd: wait timeout for healthy OSDs during upgrade or restart is "10m0s" >2022-11-23 17:19:16.457999 I | op-osd: start provisioning the OSDs on PVCs, if needed >2022-11-23 17:19:16.595465 I | op-osd: verifying PVCs exist for 8 OSDs in device set "ocs-deviceset-0" >2022-11-23 17:19:16.595483 I | op-osd: OSD PVC "ocs-deviceset-0-data-5ks6wf" already exists >2022-11-23 17:19:16.595490 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-5l7x2m" already exists >2022-11-23 17:19:16.595495 I | op-osd: OSD PVC "ocs-deviceset-0-wal-57pv6z" already exists >2022-11-23 17:19:16.595518 I | op-osd: OSD PVC "ocs-deviceset-0-data-6gm2pc" already exists >2022-11-23 17:19:16.595524 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-6f4z9s" already exists >2022-11-23 17:19:16.595528 I | op-osd: OSD PVC "ocs-deviceset-0-wal-65gnbk" already exists >2022-11-23 17:19:16.595534 I | op-osd: OSD PVC "ocs-deviceset-0-data-7bznfx" already exists >2022-11-23 17:19:16.595539 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-7bdqfj" already exists >2022-11-23 17:19:16.595543 I | op-osd: OSD PVC "ocs-deviceset-0-wal-7jps5n" already exists >2022-11-23 17:19:16.595549 I | op-osd: OSD PVC "ocs-deviceset-0-data-0bwms5" already exists >2022-11-23 17:19:16.595556 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-05l52j" already exists >2022-11-23 17:19:16.595560 I | op-osd: OSD PVC "ocs-deviceset-0-wal-0fpxq2" already exists >2022-11-23 17:19:16.595564 I | op-osd: OSD PVC "ocs-deviceset-0-data-1vd6t2" already exists >2022-11-23 17:19:16.595568 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-1jdkcg" already exists >2022-11-23 17:19:16.595583 I | op-osd: OSD PVC "ocs-deviceset-0-wal-1r6b2z" already exists >2022-11-23 17:19:16.595588 I | op-osd: OSD PVC "ocs-deviceset-0-data-2fgc98" already exists >2022-11-23 17:19:16.595592 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-2ljqb5" already exists >2022-11-23 17:19:16.595597 I | op-osd: OSD PVC "ocs-deviceset-0-wal-2fmx88" already exists >2022-11-23 17:19:16.595601 I | op-osd: OSD PVC "ocs-deviceset-0-data-38bf6x" already exists >2022-11-23 17:19:16.595608 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-38nb58" already exists >2022-11-23 17:19:16.595612 I | op-osd: OSD PVC "ocs-deviceset-0-wal-3tkdfd" already exists >2022-11-23 17:19:16.595617 I | op-osd: OSD PVC "ocs-deviceset-0-data-4bjtfw" already exists >2022-11-23 17:19:16.595620 I | op-osd: OSD PVC "ocs-deviceset-0-metadata-4fff89" already exists >2022-11-23 17:19:16.595624 I | op-osd: OSD PVC "ocs-deviceset-0-wal-4xgsvz" already exists >2022-11-23 17:19:16.595628 I | op-osd: verifying PVCs exist for 8 OSDs in device set "ocs-deviceset-1" >2022-11-23 17:19:16.595631 I | op-osd: OSD PVC "ocs-deviceset-1-data-4bcv2q" already exists >2022-11-23 17:19:16.595636 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-4hl2gm" already exists >2022-11-23 17:19:16.595641 I | op-osd: OSD PVC "ocs-deviceset-1-wal-4jzx9d" already exists >2022-11-23 17:19:16.595647 I | op-osd: OSD PVC "ocs-deviceset-1-data-5fg2rq" already exists >2022-11-23 17:19:16.595652 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-5mvm8w" already exists >2022-11-23 17:19:16.595655 I | op-osd: OSD PVC "ocs-deviceset-1-wal-5cwqh9" already exists >2022-11-23 17:19:16.595660 I | op-osd: OSD PVC "ocs-deviceset-1-data-6jjq7d" already exists >2022-11-23 17:19:16.595667 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-6w4wgm" already exists >2022-11-23 17:19:16.595672 I | op-osd: OSD PVC "ocs-deviceset-1-wal-62dgpw" already exists >2022-11-23 17:19:16.595675 I | op-osd: OSD PVC "ocs-deviceset-1-data-7kf4tb" already exists >2022-11-23 17:19:16.595679 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-7ll7pw" already exists >2022-11-23 17:19:16.595683 I | op-osd: OSD PVC "ocs-deviceset-1-wal-79jmc9" already exists >2022-11-23 17:19:16.595687 I | op-osd: OSD PVC "ocs-deviceset-1-data-0n9nmx" already exists >2022-11-23 17:19:16.595691 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-0smm8c" already exists >2022-11-23 17:19:16.595695 I | op-osd: OSD PVC "ocs-deviceset-1-wal-04hg6m" already exists >2022-11-23 17:19:16.595699 I | op-osd: OSD PVC "ocs-deviceset-1-data-1sjmbp" already exists >2022-11-23 17:19:16.595704 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-1nkrbj" already exists >2022-11-23 17:19:16.595707 I | op-osd: OSD PVC "ocs-deviceset-1-wal-14wj6w" already exists >2022-11-23 17:19:16.595711 I | op-osd: OSD PVC "ocs-deviceset-1-data-2kmplq" already exists >2022-11-23 17:19:16.595715 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-2qrzpr" already exists >2022-11-23 17:19:16.595721 I | op-osd: OSD PVC "ocs-deviceset-1-wal-25mhp6" already exists >2022-11-23 17:19:16.595725 I | op-osd: OSD PVC "ocs-deviceset-1-data-39vw7k" already exists >2022-11-23 17:19:16.595730 I | op-osd: OSD PVC "ocs-deviceset-1-metadata-3b5jhh" already exists >2022-11-23 17:19:16.595733 I | op-osd: OSD PVC "ocs-deviceset-1-wal-3rjmpt" already exists >2022-11-23 17:19:16.595736 I | op-osd: verifying PVCs exist for 8 OSDs in device set "ocs-deviceset-2" >2022-11-23 17:19:16.595742 I | op-osd: OSD PVC "ocs-deviceset-2-data-0dt89f" already exists >2022-11-23 17:19:16.595747 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-0ghkfb" already exists >2022-11-23 17:19:16.595751 I | op-osd: OSD PVC "ocs-deviceset-2-wal-0m6ldf" already exists >2022-11-23 17:19:16.595755 I | op-osd: OSD PVC "ocs-deviceset-2-data-1sg95c" already exists >2022-11-23 17:19:16.595759 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-1fdt8m" already exists >2022-11-23 17:19:16.595763 I | op-osd: OSD PVC "ocs-deviceset-2-wal-1qgp84" already exists >2022-11-23 17:19:16.595766 I | op-osd: OSD PVC "ocs-deviceset-2-data-2dtlkq" already exists >2022-11-23 17:19:16.595770 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-2ngfs9" already exists >2022-11-23 17:19:16.595773 I | op-osd: OSD PVC "ocs-deviceset-2-wal-2prbmt" already exists >2022-11-23 17:19:16.595780 I | op-osd: OSD PVC "ocs-deviceset-2-data-39nfvc" already exists >2022-11-23 17:19:16.595784 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-324rgb" already exists >2022-11-23 17:19:16.595789 I | op-osd: OSD PVC "ocs-deviceset-2-wal-3lwhts" already exists >2022-11-23 17:19:16.595792 I | op-osd: OSD PVC "ocs-deviceset-2-data-4qsl7c" already exists >2022-11-23 17:19:16.595797 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-457pkl" already exists >2022-11-23 17:19:16.595800 I | op-osd: OSD PVC "ocs-deviceset-2-wal-4q8dnm" already exists >2022-11-23 17:19:16.595803 I | op-osd: OSD PVC "ocs-deviceset-2-data-56s2sg" already exists >2022-11-23 17:19:16.595807 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-5wczjg" already exists >2022-11-23 17:19:16.595812 I | op-osd: OSD PVC "ocs-deviceset-2-wal-5s226m" already exists >2022-11-23 17:19:16.595815 I | op-osd: OSD PVC "ocs-deviceset-2-data-65vppw" already exists >2022-11-23 17:19:16.595820 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-6mlfv7" already exists >2022-11-23 17:19:16.595823 I | op-osd: OSD PVC "ocs-deviceset-2-wal-6qtnqg" already exists >2022-11-23 17:19:16.595826 I | op-osd: OSD PVC "ocs-deviceset-2-data-72v4qp" already exists >2022-11-23 17:19:16.595830 I | op-osd: OSD PVC "ocs-deviceset-2-metadata-7l8wjf" already exists >2022-11-23 17:19:16.595833 I | op-osd: OSD PVC "ocs-deviceset-2-wal-7nf8xz" already exists >2022-11-23 17:19:16.650168 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-5ks6wf" and its metadata device on "ocs-deviceset-0-metadata-5l7x2m" >2022-11-23 17:19:16.650179 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-57pv6z" >2022-11-23 17:19:16.650182 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-5ks6wf" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650186 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-6gm2pc" and its metadata device on "ocs-deviceset-0-metadata-6f4z9s" >2022-11-23 17:19:16.650187 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-65gnbk" >2022-11-23 17:19:16.650190 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-6gm2pc" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650192 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-7bznfx" and its metadata device on "ocs-deviceset-0-metadata-7bdqfj" >2022-11-23 17:19:16.650194 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-7jps5n" >2022-11-23 17:19:16.650197 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-7bznfx" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650199 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-0bwms5" and its metadata device on "ocs-deviceset-0-metadata-05l52j" >2022-11-23 17:19:16.650201 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-0fpxq2" >2022-11-23 17:19:16.650220 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-0bwms5" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650223 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-1vd6t2" and its metadata device on "ocs-deviceset-0-metadata-1jdkcg" >2022-11-23 17:19:16.650225 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-1r6b2z" >2022-11-23 17:19:16.650228 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-1vd6t2" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650230 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-2fgc98" and its metadata device on "ocs-deviceset-0-metadata-2ljqb5" >2022-11-23 17:19:16.650232 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-2fmx88" >2022-11-23 17:19:16.650235 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-2fgc98" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650237 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-38bf6x" and its metadata device on "ocs-deviceset-0-metadata-38nb58" >2022-11-23 17:19:16.650239 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-3tkdfd" >2022-11-23 17:19:16.650242 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-38bf6x" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650245 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-4bjtfw" and its metadata device on "ocs-deviceset-0-metadata-4fff89" >2022-11-23 17:19:16.650254 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-4xgsvz" >2022-11-23 17:19:16.650256 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-0-data-4bjtfw" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650259 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-4bcv2q" and its metadata device on "ocs-deviceset-1-metadata-4hl2gm" >2022-11-23 17:19:16.650260 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-4jzx9d" >2022-11-23 17:19:16.650263 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-4bcv2q" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650266 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-5fg2rq" and its metadata device on "ocs-deviceset-1-metadata-5mvm8w" >2022-11-23 17:19:16.650268 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-5cwqh9" >2022-11-23 17:19:16.650270 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-5fg2rq" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650273 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-6jjq7d" and its metadata device on "ocs-deviceset-1-metadata-6w4wgm" >2022-11-23 17:19:16.650275 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-62dgpw" >2022-11-23 17:19:16.650277 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-6jjq7d" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650279 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-7kf4tb" and its metadata device on "ocs-deviceset-1-metadata-7ll7pw" >2022-11-23 17:19:16.650281 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-79jmc9" >2022-11-23 17:19:16.650283 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-7kf4tb" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650285 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-0n9nmx" and its metadata device on "ocs-deviceset-1-metadata-0smm8c" >2022-11-23 17:19:16.650287 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-04hg6m" >2022-11-23 17:19:16.650289 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-0n9nmx" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650291 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-1sjmbp" and its metadata device on "ocs-deviceset-1-metadata-1nkrbj" >2022-11-23 17:19:16.650293 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-14wj6w" >2022-11-23 17:19:16.650295 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-1sjmbp" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650297 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-2kmplq" and its metadata device on "ocs-deviceset-1-metadata-2qrzpr" >2022-11-23 17:19:16.650299 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-25mhp6" >2022-11-23 17:19:16.650301 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-2kmplq" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650303 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-39vw7k" and its metadata device on "ocs-deviceset-1-metadata-3b5jhh" >2022-11-23 17:19:16.650305 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-3rjmpt" >2022-11-23 17:19:16.650307 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-1-data-39vw7k" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650309 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-0dt89f" and its metadata device on "ocs-deviceset-2-metadata-0ghkfb" >2022-11-23 17:19:16.650311 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-0m6ldf" >2022-11-23 17:19:16.650313 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-0dt89f" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650315 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-1sg95c" and its metadata device on "ocs-deviceset-2-metadata-1fdt8m" >2022-11-23 17:19:16.650317 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-1qgp84" >2022-11-23 17:19:16.650319 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-1sg95c" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650321 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-2dtlkq" and its metadata device on "ocs-deviceset-2-metadata-2ngfs9" >2022-11-23 17:19:16.650323 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-2prbmt" >2022-11-23 17:19:16.650325 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-2dtlkq" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650327 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-39nfvc" and its metadata device on "ocs-deviceset-2-metadata-324rgb" >2022-11-23 17:19:16.650329 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-3lwhts" >2022-11-23 17:19:16.650331 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-39nfvc" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650333 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-4qsl7c" and its metadata device on "ocs-deviceset-2-metadata-457pkl" >2022-11-23 17:19:16.650335 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-4q8dnm" >2022-11-23 17:19:16.650337 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-4qsl7c" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650339 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-56s2sg" and its metadata device on "ocs-deviceset-2-metadata-5wczjg" >2022-11-23 17:19:16.650341 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-5s226m" >2022-11-23 17:19:16.650343 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-56s2sg" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650346 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-65vppw" and its metadata device on "ocs-deviceset-2-metadata-6mlfv7" >2022-11-23 17:19:16.650348 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-6qtnqg" >2022-11-23 17:19:16.650349 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-65vppw" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650352 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-72v4qp" and its metadata device on "ocs-deviceset-2-metadata-7l8wjf" >2022-11-23 17:19:16.650354 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-7nf8xz" >2022-11-23 17:19:16.650355 I | op-osd: skipping OSD prepare job creation for PVC "ocs-deviceset-2-data-72v4qp" because OSD daemon using the PVC already exists >2022-11-23 17:19:16.650357 I | op-osd: start provisioning the OSDs on nodes, if needed >2022-11-23 17:19:16.650359 I | op-osd: no nodes are defined for configuring OSDs on raw devices >2022-11-23 17:19:17.470348 I | op-mgr: successful modules: dashboard >2022-11-23 17:19:17.470385 I | op-mgr: successful modules: prometheus >2022-11-23 17:19:17.470762 I | op-config: setting "global"="osd_pool_default_pg_autoscale_mode"="on" option to the mon configuration database >2022-11-23 17:19:17.738247 I | op-config: successfully set "global"="osd_pool_default_pg_autoscale_mode"="on" option to the mon configuration database >2022-11-23 17:19:17.738269 I | op-config: setting "global"="mon_pg_warn_min_per_osd"="0" option to the mon configuration database >2022-11-23 17:19:17.902896 I | op-osd: OSD 0 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:17.907279 I | op-osd: updating OSD 0 on PVC "ocs-deviceset-0-data-0bwms5" >2022-11-23 17:19:17.907294 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-0bwms5" and its metadata device on "ocs-deviceset-0-metadata-05l52j" >2022-11-23 17:19:17.907301 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-0fpxq2" >2022-11-23 17:19:17.907508 I | op-osd: assigning osd 0 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 17:19:17.999798 I | op-config: successfully set "global"="mon_pg_warn_min_per_osd"="0" option to the mon configuration database >2022-11-23 17:19:18.734702 I | op-mgr: successful modules: mgr module(s) from the spec >2022-11-23 17:19:19.108317 I | op-osd: OSD 1 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:19.112626 I | op-osd: updating OSD 1 on PVC "ocs-deviceset-0-data-2fgc98" >2022-11-23 17:19:19.112645 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-2fgc98" and its metadata device on "ocs-deviceset-0-metadata-2ljqb5" >2022-11-23 17:19:19.112649 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-2fmx88" >2022-11-23 17:19:19.112888 I | op-osd: assigning osd 1 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 17:19:20.254776 I | op-osd: OSD 10 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:20.259414 I | op-osd: updating OSD 10 on PVC "ocs-deviceset-1-data-4bcv2q" >2022-11-23 17:19:20.259437 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-4bcv2q" and its metadata device on "ocs-deviceset-1-metadata-4hl2gm" >2022-11-23 17:19:20.259441 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-4jzx9d" >2022-11-23 17:19:20.259651 I | op-osd: assigning osd 10 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 17:19:21.407075 I | op-osd: updating OSD 11 on PVC "ocs-deviceset-1-data-2kmplq" >2022-11-23 17:19:21.407101 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-2kmplq" and its metadata device on "ocs-deviceset-1-metadata-2qrzpr" >2022-11-23 17:19:21.407105 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-25mhp6" >2022-11-23 17:19:21.407327 I | op-osd: assigning osd 11 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 17:19:22.578270 I | op-osd: OSD 12 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:22.583025 I | op-osd: updating OSD 12 on PVC "ocs-deviceset-1-data-6jjq7d" >2022-11-23 17:19:22.583042 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-6jjq7d" and its metadata device on "ocs-deviceset-1-metadata-6w4wgm" >2022-11-23 17:19:22.583046 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-62dgpw" >2022-11-23 17:19:22.583231 I | op-osd: assigning osd 12 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 17:19:23.728821 I | op-osd: updating OSD 13 on PVC "ocs-deviceset-1-data-5fg2rq" >2022-11-23 17:19:23.728843 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-5fg2rq" and its metadata device on "ocs-deviceset-1-metadata-5mvm8w" >2022-11-23 17:19:23.728846 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-5cwqh9" >2022-11-23 17:19:23.729040 I | op-osd: assigning osd 13 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 17:19:24.855489 I | op-osd: OSD 14 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:24.860399 I | op-osd: updating OSD 14 on PVC "ocs-deviceset-2-data-0dt89f" >2022-11-23 17:19:24.860416 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-0dt89f" and its metadata device on "ocs-deviceset-2-metadata-0ghkfb" >2022-11-23 17:19:24.860420 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-0m6ldf" >2022-11-23 17:19:24.860634 I | op-osd: assigning osd 14 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 17:19:26.035563 I | op-osd: updating OSD 15 on PVC "ocs-deviceset-2-data-1sg95c" >2022-11-23 17:19:26.035587 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-1sg95c" and its metadata device on "ocs-deviceset-2-metadata-1fdt8m" >2022-11-23 17:19:26.035591 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-1qgp84" >2022-11-23 17:19:26.035817 I | op-osd: assigning osd 15 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 17:19:27.158707 I | op-osd: OSD 16 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:27.163267 I | op-osd: updating OSD 16 on PVC "ocs-deviceset-2-data-2dtlkq" >2022-11-23 17:19:27.163286 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-2dtlkq" and its metadata device on "ocs-deviceset-2-metadata-2ngfs9" >2022-11-23 17:19:27.163291 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-2prbmt" >2022-11-23 17:19:27.163494 I | op-osd: assigning osd 16 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 17:19:28.289582 I | op-osd: OSD 17 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:28.294312 I | op-osd: updating OSD 17 on PVC "ocs-deviceset-2-data-39nfvc" >2022-11-23 17:19:28.294330 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-39nfvc" and its metadata device on "ocs-deviceset-2-metadata-324rgb" >2022-11-23 17:19:28.294333 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-3lwhts" >2022-11-23 17:19:28.294531 I | op-osd: assigning osd 17 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 17:19:29.430781 I | op-osd: OSD 18 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:29.442904 I | op-osd: updating OSD 18 on PVC "ocs-deviceset-2-data-65vppw" >2022-11-23 17:19:29.442927 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-65vppw" and its metadata device on "ocs-deviceset-2-metadata-6mlfv7" >2022-11-23 17:19:29.442931 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-6qtnqg" >2022-11-23 17:19:29.443124 I | op-osd: assigning osd 18 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 17:19:30.609564 I | op-osd: updating OSD 19 on PVC "ocs-deviceset-2-data-4qsl7c" >2022-11-23 17:19:30.609588 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-4qsl7c" and its metadata device on "ocs-deviceset-2-metadata-457pkl" >2022-11-23 17:19:30.609591 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-4q8dnm" >2022-11-23 17:19:30.609812 I | op-osd: assigning osd 19 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 17:19:31.734614 I | op-osd: OSD 2 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:31.739919 I | op-osd: updating OSD 2 on PVC "ocs-deviceset-0-data-5ks6wf" >2022-11-23 17:19:31.739934 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-5ks6wf" and its metadata device on "ocs-deviceset-0-metadata-5l7x2m" >2022-11-23 17:19:31.739939 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-57pv6z" >2022-11-23 17:19:31.740147 I | op-osd: assigning osd 2 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 17:19:32.879958 I | op-osd: OSD 20 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:32.884918 I | op-osd: updating OSD 20 on PVC "ocs-deviceset-2-data-56s2sg" >2022-11-23 17:19:32.884936 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-56s2sg" and its metadata device on "ocs-deviceset-2-metadata-5wczjg" >2022-11-23 17:19:32.884940 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-5s226m" >2022-11-23 17:19:32.885143 I | op-osd: assigning osd 20 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 17:19:34.020607 I | op-osd: OSD 21 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:34.025555 I | op-osd: updating OSD 21 on PVC "ocs-deviceset-1-data-7kf4tb" >2022-11-23 17:19:34.025573 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-7kf4tb" and its metadata device on "ocs-deviceset-1-metadata-7ll7pw" >2022-11-23 17:19:34.025576 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-79jmc9" >2022-11-23 17:19:34.025768 I | op-osd: assigning osd 21 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 17:19:35.150167 I | op-osd: OSD 22 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:35.154802 I | op-osd: updating OSD 22 on PVC "ocs-deviceset-0-data-7bznfx" >2022-11-23 17:19:35.154818 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-7bznfx" and its metadata device on "ocs-deviceset-0-metadata-7bdqfj" >2022-11-23 17:19:35.154822 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-7jps5n" >2022-11-23 17:19:35.154994 I | op-osd: assigning osd 22 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 17:19:36.276174 I | op-osd: OSD 23 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:36.280416 I | op-osd: updating OSD 23 on PVC "ocs-deviceset-2-data-72v4qp" >2022-11-23 17:19:36.280434 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-2-data-72v4qp" and its metadata device on "ocs-deviceset-2-metadata-7l8wjf" >2022-11-23 17:19:36.280437 I | op-osd: OSD will have its wal device on "ocs-deviceset-2-wal-7nf8xz" >2022-11-23 17:19:36.280634 I | op-osd: assigning osd 23 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 17:19:36.602661 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:19:36.602756 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:19:36.602840 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:19:36.602916 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:19:36.603024 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:19:36.603116 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:19:36.603202 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:19:36.913220 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 17:19:37.424780 I | op-osd: OSD 3 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:37.429502 I | op-osd: updating OSD 3 on PVC "ocs-deviceset-0-data-4bjtfw" >2022-11-23 17:19:37.429524 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-4bjtfw" and its metadata device on "ocs-deviceset-0-metadata-4fff89" >2022-11-23 17:19:37.429528 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-4xgsvz" >2022-11-23 17:19:37.429721 I | op-osd: assigning osd 3 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 17:19:38.182651 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:19:38.182745 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:19:38.182809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:19:38.182869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:19:38.182933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:19:38.182995 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:19:38.183069 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:19:38.501570 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 17:19:38.587449 I | op-osd: updating OSD 4 on PVC "ocs-deviceset-0-data-1vd6t2" >2022-11-23 17:19:38.587469 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-1vd6t2" and its metadata device on "ocs-deviceset-0-metadata-1jdkcg" >2022-11-23 17:19:38.587473 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-1r6b2z" >2022-11-23 17:19:38.587704 I | op-osd: assigning osd 4 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 17:19:39.762111 I | op-osd: OSD 5 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:39.766145 I | op-osd: updating OSD 5 on PVC "ocs-deviceset-1-data-0n9nmx" >2022-11-23 17:19:39.766159 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-0n9nmx" and its metadata device on "ocs-deviceset-1-metadata-0smm8c" >2022-11-23 17:19:39.766163 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-04hg6m" >2022-11-23 17:19:39.766353 I | op-osd: assigning osd 5 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 17:19:40.920509 I | op-osd: updating OSD 6 on PVC "ocs-deviceset-0-data-38bf6x" >2022-11-23 17:19:40.920529 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-38bf6x" and its metadata device on "ocs-deviceset-0-metadata-38nb58" >2022-11-23 17:19:40.920533 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-3tkdfd" >2022-11-23 17:19:40.920711 I | op-osd: assigning osd 6 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 17:19:42.064551 I | op-osd: OSD 7 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:42.068602 I | op-osd: updating OSD 7 on PVC "ocs-deviceset-1-data-39vw7k" >2022-11-23 17:19:42.068629 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-39vw7k" and its metadata device on "ocs-deviceset-1-metadata-3b5jhh" >2022-11-23 17:19:42.068633 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-3rjmpt" >2022-11-23 17:19:42.068845 I | op-osd: assigning osd 7 topology affinity to "topology.rook.io/rack=rack2" >2022-11-23 17:19:43.201685 I | op-osd: updating OSD 8 on PVC "ocs-deviceset-0-data-6gm2pc" >2022-11-23 17:19:43.201706 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-0-data-6gm2pc" and its metadata device on "ocs-deviceset-0-metadata-6f4z9s" >2022-11-23 17:19:43.201709 I | op-osd: OSD will have its wal device on "ocs-deviceset-0-wal-65gnbk" >2022-11-23 17:19:43.201902 I | op-osd: assigning osd 8 topology affinity to "topology.rook.io/rack=rack1" >2022-11-23 17:19:44.339750 I | op-osd: OSD 9 is not ok-to-stop but 'continueUpgradeAfterChecksEvenIfNotHealthy' is true, so continuing to update it >2022-11-23 17:19:44.344035 I | op-osd: updating OSD 9 on PVC "ocs-deviceset-1-data-1sjmbp" >2022-11-23 17:19:44.344050 I | op-osd: OSD will have its main bluestore block on "ocs-deviceset-1-data-1sjmbp" and its metadata device on "ocs-deviceset-1-metadata-1nkrbj" >2022-11-23 17:19:44.344053 I | op-osd: OSD will have its wal device on "ocs-deviceset-1-wal-14wj6w" >2022-11-23 17:19:44.344235 I | op-osd: assigning osd 9 topology affinity to "topology.rook.io/rack=rack0" >2022-11-23 17:19:44.955120 I | cephclient: successfully disallowed pre-pacific osds and enabled all new pacific-only functionality >2022-11-23 17:19:44.955143 I | op-osd: finished running OSDs in namespace "openshift-storage" >2022-11-23 17:19:44.955148 I | ceph-cluster-controller: done reconciling ceph cluster in namespace "openshift-storage" >2022-11-23 17:19:52.830156 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:19:52.830245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:19:52.830306 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:19:52.830371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:19:52.830434 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:19:52.830502 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:19:52.830567 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:19:53.136280 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 17:20:07.186116 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:20:07.186214 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:20:07.186283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:20:07.186343 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:20:07.186408 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:20:07.186471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:20:07.186537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:20:07.486887 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:20:08.766207 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:20:08.766293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:20:08.766369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:20:08.766434 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:20:08.766492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:20:08.766557 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:20:08.766614 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:20:09.073497 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:20:37.748903 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:20:37.748984 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:20:37.749052 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:20:37.749118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:20:37.749188 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:20:37.749248 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:20:37.749313 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:20:38.055725 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:20:39.347425 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:20:39.347531 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:20:39.347599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:20:39.347661 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:20:39.347728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:20:39.347798 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:20:39.347860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:20:39.656928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:20:52.964653 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:20:52.964776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:20:52.964867 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:20:52.964951 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:20:52.965037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:20:52.965120 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:20:52.965202 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:20:53.270267 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:21:08.318684 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:21:08.318790 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:21:08.318874 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:21:08.318950 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:21:08.319037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:21:08.319106 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:21:08.319180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:21:08.633651 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:21:09.917045 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:21:09.917148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:21:09.917219 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:21:09.917311 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:21:09.917381 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:21:09.917454 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:21:09.917527 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:21:10.244707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:21:38.894804 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:21:38.894923 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:21:38.894999 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:21:38.895076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:21:38.895147 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:21:38.895214 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:21:38.895295 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:21:39.227026 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:21:40.508116 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:21:40.508222 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:21:40.508294 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:21:40.508386 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:21:40.508454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:21:40.508529 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:21:40.508602 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:21:40.818307 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:21:53.094064 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:21:53.094150 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:21:53.094217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:21:53.094293 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:21:53.094364 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:21:53.094427 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:21:53.094496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:21:53.400497 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:22:09.495995 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:22:09.496086 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:22:09.496148 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:22:09.496216 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:22:09.496282 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:22:09.496347 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:22:09.496413 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:22:09.795073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:22:11.080126 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:22:11.080246 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:22:11.080308 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:22:11.080381 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:22:11.080445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:22:11.080511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:22:11.080579 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:22:11.382610 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:22:40.054846 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:22:40.054928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:22:40.054990 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:22:40.055069 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:22:40.055131 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:22:40.055205 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:22:40.055267 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:22:40.363959 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:22:41.648019 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:22:41.648106 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:22:41.648183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:22:41.648241 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:22:41.648308 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:22:41.648366 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:22:41.648426 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:22:41.952691 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:22:53.223033 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:22:53.223120 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:22:53.223206 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:22:53.223282 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:22:53.223342 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:22:53.223402 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:22:53.223464 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:22:53.529225 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:23:10.623291 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:23:10.623399 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:23:10.623465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:23:10.623526 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:23:10.623591 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:23:10.623656 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:23:10.623714 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:23:10.925550 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:23:12.231729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:23:12.231829 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:23:12.231898 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:23:12.231961 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:23:12.232026 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:23:12.232088 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:23:12.232160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:23:12.532505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:23:41.184002 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:23:41.184110 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:23:41.184179 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:23:41.184249 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:23:41.184318 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:23:41.184380 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:23:41.184455 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:23:41.493138 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:23:42.795013 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:23:42.795093 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:23:42.795174 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:23:42.795239 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:23:42.795302 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:23:42.795361 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:23:42.795425 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:23:43.100680 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:23:53.344918 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:23:53.344997 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:23:53.345058 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:23:53.345123 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:23:53.345188 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:23:53.345248 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:23:53.345305 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:23:53.663776 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:24:11.755681 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:24:11.755779 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:24:11.755847 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:24:11.755915 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:24:11.755977 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:24:11.756043 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:24:11.756109 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:24:12.080869 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 17:24:13.360177 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:24:13.360266 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:24:13.360334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:24:13.360401 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:24:13.360459 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:24:13.360522 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:24:13.360591 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:24:13.670639 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 17:24:42.355971 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:24:42.356073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:24:42.356150 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:24:42.356210 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:24:42.356270 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:24:42.356337 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:24:42.356398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:24:42.664433 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 17:24:43.930450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:24:43.930535 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:24:43.930612 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:24:43.930677 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:24:43.930758 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:24:43.930824 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:24:43.930895 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:24:44.238562 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 17:24:53.476810 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:24:53.476898 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:24:53.476977 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:24:53.477043 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:24:53.477113 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:24:53.477177 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:24:53.477245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:24:53.783044 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 17:25:12.926837 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:25:12.926937 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:25:12.927002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:25:12.927075 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:25:12.928182 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:25:12.928463 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:25:12.928669 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:25:13.236016 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:25:14.500999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:25:14.501102 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:25:14.501178 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:25:14.501268 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:25:14.501345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:25:14.501426 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:25:14.501526 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:25:14.812501 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:25:43.498221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:25:43.498321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:25:43.498397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:25:43.498472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:25:43.498546 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:25:43.498608 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:25:43.498673 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:25:43.805023 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:25:45.078781 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:25:45.078881 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:25:45.078968 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:25:45.079048 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:25:45.079136 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:25:45.079211 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:25:45.079290 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:25:45.385297 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:25:53.606089 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:25:53.606210 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:25:53.606296 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:25:53.606374 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:25:53.606448 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:25:53.606527 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:25:53.606606 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:25:53.915087 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:26:14.065730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:26:14.065828 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:26:14.065905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:26:14.065985 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:26:14.066057 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:26:14.066133 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:26:14.066205 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:26:14.375396 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:26:15.647228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:26:15.647444 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:26:15.647639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:26:15.647746 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:26:15.649108 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:26:15.649504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:26:15.649678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:26:15.957960 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:26:44.637304 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:26:44.637393 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:26:44.637472 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:26:44.637547 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:26:44.637616 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:26:44.637677 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:26:44.637757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:26:44.944977 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:26:46.214496 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:26:46.214587 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:26:46.214664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:26:46.214729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:26:46.214794 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:26:46.214856 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:26:46.214922 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:26:46.520321 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:26:53.729882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:26:53.729971 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:26:53.730050 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:26:53.730119 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:26:53.730184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:26:53.730264 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:26:53.730326 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:26:54.037106 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:27:15.206517 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:27:15.206613 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:27:15.206685 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:27:15.206762 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:27:15.206824 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:27:15.206891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:27:15.206959 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:27:15.518408 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:27:16.781091 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:27:16.781169 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:27:16.781236 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:27:16.781304 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:27:16.781367 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:27:16.781431 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:27:16.781495 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:27:17.084283 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:27:45.787048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:27:45.787142 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:27:45.787208 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:27:45.787276 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:27:45.787340 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:27:45.787401 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:27:45.787464 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:27:46.092617 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:27:47.343844 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:27:47.343929 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:27:47.343996 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:27:47.344062 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:27:47.344122 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:27:47.344187 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:27:47.344253 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:27:47.649732 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:27:53.859054 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:27:53.859131 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:27:53.859202 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:27:53.859268 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:27:53.859339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:27:53.859398 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:27:53.859466 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:27:54.168106 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:28:16.356508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:28:16.356668 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:28:16.356778 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:28:16.356880 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:28:16.356994 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:28:16.357111 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:28:16.357198 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:28:16.668878 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:28:17.915264 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:28:17.915374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:28:17.915446 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:28:17.915534 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:28:17.915629 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:28:17.915694 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:28:17.915787 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:28:18.217453 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:28:46.938173 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:28:46.938278 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:28:46.938365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:28:46.938473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:28:46.938547 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:28:46.938639 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:28:46.938749 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:28:47.246758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:28:48.478402 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:28:48.478503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:28:48.478568 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:28:48.478634 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:28:48.478703 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:28:48.478775 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:28:48.478846 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:28:48.784093 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:28:53.981941 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:28:53.982020 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:28:53.982084 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:28:53.982155 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:28:53.982218 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:28:53.982282 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:28:53.982349 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:28:54.291157 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:29:17.510679 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:29:17.510819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:29:17.510895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:29:17.511007 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:29:17.511085 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:29:17.511157 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:29:17.511233 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:29:17.824574 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:29:19.048362 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:29:19.048472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:29:19.048538 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:29:19.048600 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:29:19.048673 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:29:19.048741 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:29:19.048805 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:29:19.349737 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:29:48.086048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:29:48.086143 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:29:48.086222 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:29:48.086287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:29:48.086356 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:29:48.086435 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:29:48.086501 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:29:48.395102 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:29:49.612329 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:29:49.613419 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:29:49.613837 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:29:49.614741 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:29:49.615546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:29:49.615634 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:29:49.615707 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:29:49.925514 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:29:54.108083 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:29:54.108171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:29:54.108240 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:29:54.108304 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:29:54.108371 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:29:54.108437 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:29:54.108505 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:29:54.423819 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:30:18.660709 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:30:18.660801 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:30:18.660882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:30:18.660943 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:30:18.661011 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:30:18.661073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:30:18.661137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:30:18.969233 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:30:20.188804 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:30:20.188945 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:30:20.189059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:30:20.189172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:30:20.189271 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:30:20.189379 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:30:20.189479 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:30:20.497861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:30:49.239441 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:30:49.239522 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:30:49.239587 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:30:49.239653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:30:49.239716 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:30:49.239784 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:30:49.239848 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:30:49.549380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:30:50.759991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:30:50.760086 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:30:50.760159 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:30:50.760226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:30:50.760287 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:30:50.760345 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:30:50.760410 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:30:51.063908 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:30:54.235182 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:30:54.235261 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:30:54.236268 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:30:54.236865 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:30:54.237350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:30:54.237927 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:30:54.238053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:30:54.548746 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:31:19.813097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:31:19.813190 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:31:19.813256 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:31:19.813324 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:31:19.813391 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:31:19.813460 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:31:19.813521 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:31:20.120533 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:31:21.327009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:31:21.327090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:31:21.327157 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:31:21.327215 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:31:21.327282 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:31:21.327343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:31:21.327408 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:31:21.628503 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:31:50.382982 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:31:50.383100 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:31:50.383160 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:31:50.383225 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:31:50.383290 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:31:50.383353 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:31:50.383410 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:31:50.687545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:31:51.890284 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:31:51.890365 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:31:51.890434 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:31:51.890499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:31:51.890566 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:31:51.890630 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:31:51.890688 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:31:52.210078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:31:54.366147 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:31:54.366228 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:31:54.366291 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:31:54.366358 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:31:54.366422 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:31:54.366484 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:31:54.366548 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:31:54.676053 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:32:20.952930 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:32:20.953022 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:32:20.953082 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:32:20.953145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:32:20.953209 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:32:20.953277 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:32:20.953337 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:32:21.261475 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:32:22.476415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:32:22.476519 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:32:22.476591 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:32:22.476654 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:32:22.476727 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:32:22.476792 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:32:22.476851 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:32:22.778867 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:32:51.525669 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:32:51.525771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:32:51.525834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:32:51.525897 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:32:51.525955 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:32:51.526025 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:32:51.526089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:32:51.845622 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:32:53.040905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:32:53.040991 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:32:53.041051 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:32:53.041125 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:32:53.041186 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:32:53.041269 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:32:53.041329 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:32:53.345123 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:32:54.493414 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:32:54.493493 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:32:54.493560 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:32:54.493624 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:32:54.493684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:32:54.493754 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:32:54.493824 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:32:54.797557 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:33:22.110204 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:33:22.110639 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:33:22.111156 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:33:22.111464 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:33:22.112157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:33:22.112247 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:33:22.112320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:33:22.420684 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:33:23.608921 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:33:23.609009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:33:23.609075 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:33:23.609140 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:33:23.609205 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:33:23.609268 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:33:23.609331 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:33:23.917502 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:33:52.681965 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:33:52.682046 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:33:52.682113 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:33:52.682180 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:33:52.682256 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:33:52.682319 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:33:52.682379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:33:52.987293 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:33:54.176461 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:33:54.176546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:33:54.176631 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:33:54.176704 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:33:54.176776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:33:54.176838 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:33:54.176901 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:33:54.482212 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:33:54.753688 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:33:54.753773 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:33:54.753843 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:33:54.753917 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:33:54.753986 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:33:54.754055 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:33:54.754124 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:33:55.068570 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:34:23.248797 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:34:23.248885 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:34:23.248956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:34:23.249025 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:34:23.249103 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:34:23.249170 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:34:23.249233 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:34:23.557611 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:34:24.753509 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:34:24.753608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:34:24.753685 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:34:24.753759 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:34:24.753835 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:34:24.753908 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:34:24.753996 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:34:25.067356 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:34:53.813452 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:34:53.813544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:34:53.813615 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:34:53.813679 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:34:53.813750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:34:53.813814 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:34:53.813874 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:34:54.123998 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:34:54.750310 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:34:54.750389 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:34:54.750467 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:34:54.750533 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:34:54.750598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:34:54.750656 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:34:54.750729 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:34:55.055513 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:34:55.327250 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:34:55.327327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:34:55.327395 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:34:55.327459 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:34:55.327519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:34:55.327579 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:34:55.327653 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:34:55.632031 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:35:24.389708 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:35:24.389814 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:35:24.389879 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:35:24.389938 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:35:24.390011 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:35:24.390073 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:35:24.390140 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:35:24.699130 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:35:25.890108 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:35:25.890191 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:35:25.890254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:35:25.890329 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:35:25.890389 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:35:25.890453 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:35:25.890513 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:35:26.197807 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:35:54.885560 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:35:54.885641 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:35:54.885706 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:35:54.885777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:35:54.885839 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:35:54.885911 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:35:54.885978 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:35:55.228860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:35:55.485837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:35:55.485920 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:35:55.486000 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:35:55.486065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:35:55.486125 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:35:55.486188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:35:55.486251 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:35:55.794534 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:35:56.459426 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:35:56.459530 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:35:56.459597 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:35:56.459669 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:35:56.459733 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:35:56.459797 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:35:56.459855 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:35:56.768692 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:36:25.488249 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:36:25.488335 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:36:25.488403 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:36:25.488482 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:36:25.488545 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:36:25.488605 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:36:25.488665 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:36:25.795790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:36:27.029601 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:36:27.029683 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:36:27.029757 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:36:27.029827 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:36:27.029885 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:36:27.029954 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:36:27.030011 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:36:27.339970 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:36:55.014973 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:36:55.015065 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:36:55.015144 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:36:55.015214 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:36:55.015278 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:36:55.015341 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:36:55.015404 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:36:55.328807 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:36:56.060433 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:36:56.060510 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:36:56.060590 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:36:56.060646 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:36:56.060713 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:36:56.060777 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:36:56.060839 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:36:56.371327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:36:57.606127 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:36:57.606219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:36:57.606279 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:36:57.606343 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:36:57.606402 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:36:57.606464 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:36:57.606525 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:36:57.912551 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:37:26.631878 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:37:26.631963 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:37:26.632023 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:37:26.632087 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:37:26.632147 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:37:26.632209 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:37:26.632278 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:37:26.941656 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:37:28.172327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:37:28.172416 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:37:28.172488 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:37:28.172546 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:37:28.172604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:37:28.172662 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:37:28.172729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:37:28.481305 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:37:55.141495 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:37:55.141583 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:37:55.141655 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:37:55.141734 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:37:55.141821 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:37:55.141877 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:37:55.141935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:37:55.446202 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:37:57.206208 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:37:57.206302 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:37:57.206368 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:37:57.206435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:37:57.206500 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:37:57.206565 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:37:57.206629 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:37:57.514243 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:37:58.749026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:37:58.749111 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:37:58.749185 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:37:58.749244 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:37:58.749312 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:37:58.749373 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:37:58.749435 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:37:59.063212 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:38:27.774483 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:38:27.774571 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:38:27.774645 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:38:27.774707 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:38:27.774786 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:38:27.774852 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:38:27.774912 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:38:28.081307 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:38:29.325775 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:38:29.325871 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:38:29.325931 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:38:29.325999 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:38:29.326058 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:38:29.326117 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:38:29.326179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:38:29.633505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:38:55.264911 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:38:55.264993 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:38:55.265064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:38:55.265125 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:38:55.265198 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:38:55.265258 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:38:55.265333 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:38:55.571130 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:38:58.351305 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:38:58.351412 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:38:58.351487 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:38:58.351548 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:38:58.351609 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:38:58.351670 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:38:58.351737 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:38:58.664994 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:38:59.895966 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:38:59.896055 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:38:59.896127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:38:59.896191 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:38:59.896261 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:38:59.896320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:38:59.896389 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:39:00.208697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:39:28.937354 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:39:28.937435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:39:28.937511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:39:28.937572 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:39:28.937635 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:39:28.937692 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:39:28.937767 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:39:29.245761 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:39:30.474817 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:39:30.474898 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:39:30.474974 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:39:30.475036 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:39:30.475099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:39:30.475161 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:39:30.475223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:39:30.784011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:39:55.393407 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:39:55.393489 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:39:55.393557 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:39:55.393629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:39:55.393691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:39:55.393765 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:39:55.393821 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:39:55.704117 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:39:59.510405 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:39:59.510501 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:39:59.510572 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:39:59.510635 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:39:59.510701 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:39:59.510761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:39:59.510821 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:39:59.814341 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:40:01.044062 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:40:01.044185 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:40:01.044261 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:40:01.044323 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:40:01.044382 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:40:01.044441 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:40:01.044504 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:40:01.354111 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:40:30.095282 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:40:30.095372 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:40:30.095441 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:40:30.095511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:40:30.095578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:40:30.095645 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:40:30.095711 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:40:30.405460 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:40:31.614750 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:40:31.614843 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:40:31.614909 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:40:31.614969 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:40:31.615033 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:40:31.615092 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:40:31.615154 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:40:31.928399 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:40:55.522014 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:40:55.522091 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:40:55.522169 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:40:55.522232 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:40:55.522298 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:40:55.522357 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:40:55.522427 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:40:55.830651 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:41:00.676381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:41:00.676489 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:41:00.676558 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:41:00.676620 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:41:00.676681 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:41:00.676749 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:41:00.676811 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:41:00.983049 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:41:02.196529 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:41:02.196612 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:41:02.196683 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:41:02.196745 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:41:02.196818 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:41:02.196878 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:41:02.196941 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:41:02.507417 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:41:31.242334 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:41:31.242411 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:41:31.242494 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:41:31.242562 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:41:31.242627 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:41:31.242688 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:41:31.242762 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:41:31.551128 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:41:32.767388 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:41:32.767470 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:41:32.767542 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:41:32.767602 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:41:32.767665 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:41:32.767728 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:41:32.767788 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:41:33.075748 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:41:55.645096 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:41:55.645172 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:41:55.645237 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:41:55.645297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:41:55.645361 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:41:55.645428 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:41:55.645493 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:41:55.954263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:42:01.828013 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:42:01.828093 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:42:01.828161 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:42:01.828220 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:42:01.828282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:42:01.828345 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:42:01.828412 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:42:02.152188 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:42:03.339953 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:42:03.340038 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:42:03.340108 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:42:03.340185 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:42:03.340247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:42:03.340313 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:42:03.340374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:42:03.654271 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:42:32.418144 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:42:32.418225 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:42:32.418292 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:42:32.418363 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:42:32.418428 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:42:32.418491 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:42:32.418547 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:42:32.725165 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:42:33.915611 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:42:33.915700 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:42:33.915771 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:42:33.915833 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:42:33.915906 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:42:33.915971 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:42:33.916031 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:42:34.229464 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:42:55.776218 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:42:55.776299 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:42:55.776363 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:42:55.776428 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:42:55.776495 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:42:55.776555 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:42:55.776614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:42:56.085520 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:43:02.987931 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:43:02.988010 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:43:02.988095 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:43:02.988157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:43:02.988221 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:43:02.988282 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:43:02.988344 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:43:03.301398 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:43:04.491184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:43:04.491272 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:43:04.491341 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:43:04.491404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:43:04.491467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:43:04.491531 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:43:04.491597 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:43:04.801340 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:43:33.562626 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:43:33.562715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:43:33.562795 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:43:33.562857 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:43:33.562922 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:43:33.562996 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:43:33.563068 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:43:33.872121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:43:35.067545 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:43:35.067683 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:43:35.067766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:43:35.067834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:43:35.067902 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:43:35.067966 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:43:35.068027 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:43:35.372376 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:43:55.904723 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:43:55.904800 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:43:55.904877 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:43:55.904939 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:43:55.905009 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:43:55.905073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:43:55.905136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:43:56.208837 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:44:04.136530 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:44:04.136610 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:44:04.136678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:44:04.136778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:44:04.136841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:44:04.136900 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:44:04.136960 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:44:04.444586 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:44:05.634279 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:44:05.634360 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:44:05.634423 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:44:05.634495 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:44:05.634563 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:44:05.634629 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:44:05.634700 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:44:05.938482 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:44:34.709660 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:44:34.709748 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:44:34.709823 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:44:34.709886 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:44:34.709955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:44:34.710009 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:44:34.710069 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:44:35.019334 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:44:36.200270 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:44:36.200386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:44:36.200461 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:44:36.200529 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:44:36.200593 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:44:36.200658 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:44:36.200727 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:44:36.507144 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:44:56.027151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:44:56.027227 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:44:56.027288 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:44:56.027347 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:44:56.027416 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:44:56.027478 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:44:56.027546 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:44:56.335970 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:45:05.283497 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:45:05.283591 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:45:05.283673 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:45:05.283741 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:45:05.283803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:45:05.283865 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:45:05.283927 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:45:05.588818 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:45:06.777016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:45:06.777098 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:45:06.777168 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:45:06.777225 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:45:06.777288 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:45:06.777352 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:45:06.777414 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:45:07.088935 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:45:35.851043 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:45:35.851135 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:45:35.851210 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:45:35.851267 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:45:35.851329 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:45:35.851389 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:45:35.851448 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:45:36.160293 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:45:37.350698 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:45:37.350791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:45:37.350858 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:45:37.350936 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:45:37.350993 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:45:37.351054 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:45:37.351118 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:45:37.655445 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:45:56.148576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:45:56.148665 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:45:56.148743 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:45:56.148831 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:45:56.148901 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:45:56.148971 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:45:56.149049 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:45:56.452255 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:46:06.421161 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:46:06.421244 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:46:06.421308 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:46:06.421372 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:46:06.421436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:46:06.421494 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:46:06.421554 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:46:06.724661 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:46:07.913191 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:46:07.913293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:46:07.913370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:46:07.913450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:46:07.913523 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:46:07.913582 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:46:07.913656 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:46:08.216670 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:46:36.982948 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:46:36.983035 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:46:36.983123 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:46:36.983189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:46:36.983267 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:46:36.983332 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:46:36.983407 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:46:37.288975 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:46:38.476094 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:46:38.476193 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:46:38.476279 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:46:38.476352 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:46:38.476423 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:46:38.476488 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:46:38.476559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:46:38.781166 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:46:56.277108 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:46:56.277206 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:46:56.277288 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:46:56.277353 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:46:56.277410 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:46:56.277477 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:46:56.277539 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:46:56.591174 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:47:07.550020 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:47:07.550122 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:47:07.550194 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:47:07.550251 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:47:07.550316 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:47:07.550382 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:47:07.550455 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:47:07.864887 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:47:09.042390 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:47:09.042490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:47:09.042571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:47:09.042634 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:47:09.042690 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:47:09.042763 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:47:09.042824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:47:09.355635 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:47:38.128163 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:47:38.128251 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:47:38.128325 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:47:38.128392 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:47:38.128453 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:47:38.128517 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:47:38.128574 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:47:38.433207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:47:39.618497 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:47:39.618622 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:47:39.618698 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:47:39.618776 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:47:39.618845 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:47:39.618914 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:47:39.618986 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:47:39.929288 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:47:56.401756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:47:56.401840 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:47:56.401925 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:47:56.401994 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:47:56.402057 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:47:56.402114 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:47:56.402181 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:47:56.716097 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:48:08.705698 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:48:08.705785 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:48:08.705860 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:48:08.705928 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:48:08.705993 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:48:08.706048 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:48:08.706108 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:48:09.009127 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:48:10.194898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:48:10.194974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:48:10.195039 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:48:10.195101 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:48:10.195166 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:48:10.195227 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:48:10.195293 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:48:10.496489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:48:39.274274 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:48:39.274361 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:48:39.274433 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:48:39.274505 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:48:39.274569 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:48:39.274630 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:48:39.274690 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:48:39.580217 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:48:40.761674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:48:40.761780 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:48:40.761847 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:48:40.761907 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:48:40.761968 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:48:40.762031 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:48:40.762095 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:48:41.081347 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:48:56.525190 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:48:56.525279 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:48:56.525345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:48:56.525413 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:48:56.525478 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:48:56.525541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:48:56.525602 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:48:56.835843 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:49:09.849545 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:49:09.849638 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:49:09.849732 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:49:09.849818 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:49:09.849880 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:49:09.849941 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:49:09.849998 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:49:10.175308 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:49:11.346505 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:49:11.346586 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:49:11.346656 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:49:11.346721 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:49:11.346788 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:49:11.346847 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:49:11.346906 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:49:11.647003 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:49:40.441279 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:49:40.441357 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:49:40.441424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:49:40.441489 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:49:40.441557 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:49:40.441618 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:49:40.441685 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:49:40.753340 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:49:41.910805 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:49:41.910891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:49:41.910963 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:49:41.911028 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:49:41.911088 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:49:41.911150 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:49:41.911214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:49:42.221404 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:49:56.642274 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:49:56.642358 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:49:56.642423 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:49:56.642482 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:49:56.642552 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:49:56.642610 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:49:56.642673 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:49:56.951869 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:50:11.015403 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:50:11.015488 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:50:11.015557 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:50:11.015618 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:50:11.015674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:50:11.015757 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:50:11.015819 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:50:11.322389 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:50:12.487802 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:50:12.487905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:50:12.487982 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:50:12.488046 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:50:12.488111 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:50:12.488178 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:50:12.488247 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:50:12.797082 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:50:41.585514 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:50:41.585627 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:50:41.585703 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:50:41.585793 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:50:41.585873 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:50:41.585954 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:50:41.586032 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:50:41.897818 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:50:43.060223 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:50:43.060309 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:50:43.060382 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:50:43.060450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:50:43.060525 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:50:43.060597 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:50:43.060668 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:50:43.364306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:50:56.767632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:50:56.767713 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:50:56.767789 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:50:56.767860 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:50:56.767927 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:50:56.767994 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:50:56.768050 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:50:57.074604 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:51:12.162620 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:51:12.162710 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:51:12.162778 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:51:12.162846 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:51:12.162912 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:51:12.162980 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:51:12.163043 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:51:12.470568 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:51:13.635953 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:51:13.636081 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:51:13.636154 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:51:13.636230 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:51:13.636304 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:51:13.636377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:51:13.636448 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:51:13.946678 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:51:42.731520 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:51:42.731618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:51:42.731701 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:51:42.731787 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:51:42.731869 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:51:42.731945 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:51:42.732026 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:51:43.035866 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:51:44.216249 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:51:44.216360 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:51:44.216440 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:51:44.216521 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:51:44.216616 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:51:44.216696 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:51:44.216785 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:51:44.522707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:51:56.891843 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:51:56.891945 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:51:56.892023 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:51:56.892098 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:51:56.892182 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:51:56.892260 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:51:56.892340 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:51:57.197780 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:52:13.300262 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:52:13.300383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:52:13.300461 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:52:13.300529 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:52:13.300611 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:52:13.300683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:52:13.300773 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:52:13.605192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:52:14.783938 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:52:14.784050 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:52:14.784128 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:52:14.784211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:52:14.784289 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:52:14.784367 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:52:14.784448 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:52:15.083478 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:52:43.865846 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:52:43.865952 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:52:43.866045 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:52:43.866149 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:52:43.866249 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:52:43.866336 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:52:43.866428 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:52:44.172317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:52:45.339057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:52:45.339142 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:52:45.339215 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:52:45.339282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:52:45.339344 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:52:45.339405 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:52:45.339462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:52:45.645524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:52:57.012885 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:52:57.012969 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:52:57.013054 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:52:57.013120 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:52:57.013202 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:52:57.013266 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:52:57.013343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:52:57.317917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:53:14.437106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:53:14.437206 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:53:14.437275 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:53:14.437340 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:53:14.437432 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:53:14.437504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:53:14.437576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:53:14.752427 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:53:15.903939 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:53:15.904028 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:53:15.904104 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:53:15.904173 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:53:15.904251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:53:15.904319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:53:15.904385 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:53:16.207997 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:53:45.015117 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:53:45.015220 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:53:45.015293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:53:45.015370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:53:45.015436 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:53:45.015492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:53:45.015572 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:53:45.323817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:53:46.471698 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:53:46.471827 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:53:46.471946 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:53:46.472037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:53:46.472124 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:53:46.472212 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:53:46.472289 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:53:46.785559 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:53:57.132558 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:53:57.132636 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:53:57.132698 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:53:57.132767 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:53:57.132838 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:53:57.132904 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:53:57.132974 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:53:57.437881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:54:15.581098 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:54:15.581177 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:54:15.581245 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:54:15.581317 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:54:15.581388 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:54:15.581451 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:54:15.581517 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:54:15.885916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:54:17.047394 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:54:17.047505 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:54:17.047572 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:54:17.047640 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:54:17.047702 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:54:17.047772 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:54:17.047833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:54:17.351068 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:54:46.146877 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:54:46.146961 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:54:46.147031 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:54:46.147097 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:54:46.147161 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:54:46.147224 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:54:46.147284 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:54:46.455523 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:54:47.612902 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:54:47.612984 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:54:47.613058 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:54:47.613119 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:54:47.613172 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:54:47.613231 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:54:47.613294 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:54:47.927360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:54:57.252336 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:54:57.252415 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:54:57.252481 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:54:57.252548 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:54:57.252612 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:54:57.252674 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:54:57.252748 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:54:57.557860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:55:16.716635 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:55:16.716712 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:55:16.716781 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:55:16.716847 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:55:16.716908 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:55:16.716968 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:55:16.717025 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:55:17.023819 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:55:18.199984 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:55:18.200065 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:55:18.200137 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:55:18.200198 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:55:18.200260 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:55:18.200332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:55:18.200394 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:55:18.510744 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:55:47.285658 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:55:47.285741 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:55:47.285809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:55:47.285874 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:55:47.285937 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:55:47.285998 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:55:47.286063 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:55:47.589455 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:55:48.785095 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:55:48.785178 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:55:48.785251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:55:48.785319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:55:48.785385 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:55:48.785449 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:55:48.785509 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:55:49.098157 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:55:57.373046 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:55:57.373117 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:55:57.373181 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:55:57.373241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:55:57.373298 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:55:57.373356 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:55:57.373415 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:55:57.678399 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:56:17.869076 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:56:17.869171 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:56:17.869232 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:56:17.869296 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:56:17.869354 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:56:17.869417 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:56:17.869476 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:56:18.177827 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:56:19.366665 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:56:19.366757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:56:19.366821 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:56:19.366883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:56:19.366951 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:56:19.367016 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:56:19.367077 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:56:19.687272 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:56:48.437555 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:56:48.437635 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:56:48.437701 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:56:48.437784 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:56:48.437843 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:56:48.437927 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:56:48.437997 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:56:48.754097 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:56:49.959945 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:56:49.960027 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:56:49.960095 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:56:49.960156 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:56:49.960222 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:56:49.960279 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:56:49.960338 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:56:50.272695 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:56:57.489517 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:56:57.489595 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:56:57.489665 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:56:57.489748 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:56:57.489811 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:56:57.489870 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:56:57.489935 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:56:57.793633 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:57:19.019233 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:57:19.019322 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:57:19.019387 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:57:19.019454 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:57:19.019518 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:57:19.019584 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:57:19.019644 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:57:19.325224 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:57:20.539488 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:57:20.539590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:57:20.539661 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:57:20.539733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:57:20.539797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:57:20.539864 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:57:20.539928 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:57:20.842960 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:57:49.584791 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:57:49.584872 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:57:49.584931 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:57:49.585001 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:57:49.585064 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:57:49.585128 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:57:49.585187 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:57:49.898628 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:57:51.105815 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:57:51.105899 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:57:51.105962 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:57:51.106034 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:57:51.106097 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:57:51.106161 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:57:51.106221 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:57:51.410344 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:57:57.606944 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:57:57.607026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:57:57.607097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:57:57.607162 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:57:57.607228 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:57:57.607292 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:57:57.607348 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:57:57.915567 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:58:20.170282 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:58:20.170374 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:58:20.170457 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:58:20.170537 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:58:20.170604 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:58:20.170660 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:58:20.170727 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:58:20.495286 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:58:21.671491 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:58:21.671582 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:58:21.671655 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:58:21.671726 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:58:21.671790 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:58:21.671853 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:58:21.671914 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:58:21.977121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:58:50.770613 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:58:50.770703 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:58:50.770776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:58:50.770843 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:58:50.770905 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:58:50.770972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:58:50.771037 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:58:51.086370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:58:52.251973 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:58:52.252070 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:58:52.252135 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:58:52.252202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:58:52.252269 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:58:52.252334 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:58:52.252393 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:58:52.552534 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:58:57.726450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:58:57.726531 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:58:57.726589 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:58:57.726658 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:58:57.726721 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:58:57.726787 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:58:57.726844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:58:58.032987 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:59:21.352955 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:59:21.353046 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:59:21.353113 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:59:21.353187 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:59:21.353258 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:59:21.353325 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:59:21.353390 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:59:21.653306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:59:22.819072 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:59:22.819171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:59:22.819230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:59:22.819296 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:59:22.819361 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:59:22.819421 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:59:22.819489 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:59:23.128899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:59:51.916155 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:59:51.916237 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:59:51.916305 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:59:51.916370 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:59:51.916432 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:59:51.916507 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:59:51.916568 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:59:52.241425 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:59:53.394297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:59:53.394383 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:59:53.394445 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:59:53.394506 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:59:53.394566 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:59:53.394635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:59:53.394714 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:59:53.703212 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 17:59:57.843919 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 17:59:57.843997 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 17:59:57.844061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 17:59:57.844119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 17:59:57.844188 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 17:59:57.844249 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 17:59:57.844308 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 17:59:58.148235 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:00:22.502491 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:00:22.502573 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:00:22.502643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:00:22.502704 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:00:22.502776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:00:22.502833 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:00:22.502903 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:00:22.806554 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:00:23.970179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:00:23.970269 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:00:23.971179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:00:23.971428 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:00:23.971601 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:00:23.972010 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:00:23.972665 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:00:24.285388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:00:53.064235 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:00:53.064317 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:00:53.064381 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:00:53.064445 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:00:53.064507 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:00:53.064564 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:00:53.064628 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:00:53.372703 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:00:54.542303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:00:54.542389 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:00:54.542452 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:00:54.542520 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:00:54.542588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:00:54.542653 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:00:54.542716 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:00:54.848940 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:00:57.961728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:00:57.961809 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:00:57.961879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:00:57.961945 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:00:57.962002 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:00:57.962064 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:00:57.962127 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:00:58.266308 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:01:23.633807 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:01:23.633915 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:01:23.633983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:01:23.634050 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:01:23.634107 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:01:23.634172 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:01:23.634234 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:01:23.942867 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:01:25.124045 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:01:25.124128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:01:25.124201 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:01:25.124268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:01:25.124333 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:01:25.124393 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:01:25.124458 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:01:25.432668 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:01:54.208736 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:01:54.208828 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:01:54.208893 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:01:54.208961 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:01:54.209021 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:01:54.209083 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:01:54.209143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:01:54.518784 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:01:55.694440 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:01:55.694519 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:01:55.694592 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:01:55.694655 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:01:55.694715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:01:55.694775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:01:55.694839 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:01:56.002231 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:01:58.082140 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:01:58.082213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:01:58.082274 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:01:58.082340 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:01:58.082401 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:01:58.082462 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:01:58.082527 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:01:58.390969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:02:24.776487 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:02:24.776570 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:02:24.776659 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:02:24.776726 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:02:24.776792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:02:24.776852 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:02:24.776919 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:02:25.095691 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:02:26.264186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:02:26.264272 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:02:26.264352 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:02:26.264413 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:02:26.264476 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:02:26.264542 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:02:26.264607 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:02:26.565861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:02:55.354882 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:02:55.355002 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:02:55.355066 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:02:55.355129 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:02:55.355917 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:02:55.356183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:02:55.356381 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:02:55.655335 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:02:56.826601 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:02:56.826715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:02:56.826813 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:02:56.826898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:02:56.826976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:02:56.827059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:02:56.827134 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:02:57.127521 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:02:58.201764 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:02:58.201853 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:02:58.201926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:02:58.201996 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:02:58.202072 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:02:58.202142 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:02:58.202211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:02:58.507036 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:03:25.915959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:03:25.916052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:03:25.916119 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:03:25.916187 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:03:25.916253 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:03:25.916312 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:03:25.916373 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:03:26.225116 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:03:27.389417 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:03:27.389503 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:03:27.389566 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:03:27.389626 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:03:27.389686 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:03:27.389757 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:03:27.389822 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:03:27.693065 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:03:56.484532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:03:56.484617 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:03:56.484691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:03:56.484760 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:03:56.484821 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:03:56.484879 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:03:56.484940 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:03:56.792616 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:03:57.950469 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:03:57.950679 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:03:57.950853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:03:57.951350 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:03:57.951562 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:03:57.952248 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:03:57.952344 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:03:58.262963 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:03:58.526807 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:03:58.526890 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:03:58.526961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:03:58.527027 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:03:58.527092 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:03:58.527150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:03:58.527214 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:03:58.828118 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:04:27.059170 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:04:27.059261 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:04:27.059332 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:04:27.059405 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:04:27.059468 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:04:27.059545 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:04:27.059614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:04:27.368440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:04:28.528015 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:04:28.528114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:04:28.528185 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:04:28.528249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:04:28.528312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:04:28.528378 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:04:28.528443 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:04:28.836989 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:04:57.634214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:04:57.634334 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:04:57.634410 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:04:57.634485 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:04:57.634560 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:04:57.634634 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:04:57.634725 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:04:57.938857 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:04:58.449744 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:04:58.449854 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:04:58.449937 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:04:58.450004 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:04:58.450090 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:04:58.450162 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:04:58.450236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:04:58.760884 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:04:59.100467 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:04:59.100556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:04:59.100628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:04:59.100701 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:04:59.100784 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:04:59.100857 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:04:59.102005 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:04:59.412924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:05:28.198644 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:05:28.198740 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:05:28.198813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:05:28.198885 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:05:28.198951 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:05:28.199018 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:05:28.199087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:05:28.505916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:05:29.680795 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:05:29.680900 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:05:29.680970 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:05:29.681036 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:05:29.681107 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:05:29.681169 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:05:29.681231 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:05:29.990219 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:05:58.572987 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:05:58.573070 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:05:58.573144 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:05:58.573208 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:05:58.573265 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:05:58.573323 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:05:58.573383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:05:58.880869 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:05:59.142310 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:05:59.142396 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:05:59.142458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:05:59.142523 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:05:59.142587 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:05:59.142649 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:05:59.142708 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:05:59.445769 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:06:00.263465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:06:00.263588 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:06:00.263670 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:06:00.263748 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:06:00.263823 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:06:00.263891 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:06:00.263956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:06:00.567680 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:06:29.144164 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:06:29.144249 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:06:29.144315 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:06:29.144377 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:06:29.145457 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:06:29.146052 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:06:29.146662 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:06:29.458015 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:06:30.826533 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:06:30.826613 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:06:30.826675 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:06:30.826742 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:06:30.826802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:06:30.826866 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:06:30.826945 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:06:31.142029 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:06:58.690406 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:06:58.690490 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:06:58.690561 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:06:58.690631 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:06:58.690699 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:06:58.690780 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:06:58.690854 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:06:59.005038 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:06:59.729676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:06:59.729762 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:06:59.729832 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:06:59.729905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:06:59.729969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:06:59.730030 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:06:59.730090 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:07:00.028819 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:07:01.406211 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:07:01.406292 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:07:01.406362 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:07:01.406432 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:07:01.406491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:07:01.406555 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:07:01.406618 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:07:01.712073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:07:30.291013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:07:30.291093 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:07:30.291161 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:07:30.291224 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:07:30.291283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:07:30.291348 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:07:30.291411 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:07:30.599589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:07:31.983387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:07:31.983490 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:07:31.983577 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:07:31.983639 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:07:31.983709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:07:31.983776 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:07:31.983834 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:07:32.318320 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:07:58.810686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:07:58.810772 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:07:58.810839 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:07:58.810905 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:07:58.810966 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:07:58.811027 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:07:58.811092 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:07:59.122956 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:08:00.868027 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:08:00.868118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:08:00.868184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:08:00.868242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:08:00.868307 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:08:00.868373 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:08:00.868440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:08:01.173549 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:08:02.581474 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:08:02.581581 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:08:02.581642 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:08:02.581704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:08:02.581770 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:08:02.581831 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:08:02.581897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:08:02.890546 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:08:31.439933 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:08:31.440022 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:08:31.440103 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:08:31.440162 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:08:31.440226 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:08:31.440292 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:08:31.440348 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:08:31.740535 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:08:33.152284 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:08:33.152380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:08:33.152442 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:08:33.152506 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:08:33.152571 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:08:33.152631 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:08:33.152697 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:08:33.466456 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:08:58.932319 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:08:58.932403 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:08:58.932485 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:08:58.932546 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:08:58.932608 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:08:58.932672 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:08:58.932740 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:08:59.247086 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:09:02.001251 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:09:02.001364 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:09:02.001442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:09:02.001513 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:09:02.001573 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:09:02.001639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:09:02.001701 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:09:02.317921 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:09:03.726194 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:09:03.726278 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:09:03.726353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:09:03.726411 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:09:03.726473 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:09:03.726551 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:09:03.726616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:09:04.033144 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:09:32.581608 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:09:32.581707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:09:32.581793 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:09:32.581875 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:09:32.581942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:09:32.582015 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:09:32.582094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:09:32.895766 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:09:34.293259 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:09:34.293356 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:09:34.293412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:09:34.293487 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:09:34.293547 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:09:34.293614 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:09:34.293674 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:09:34.608168 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:09:59.049418 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:09:59.049498 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:09:59.049563 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:09:59.049624 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:09:59.049688 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:09:59.049762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:09:59.049825 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:09:59.360442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:10:03.161753 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:10:03.161838 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:10:03.161908 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:10:03.161970 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:10:03.162033 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:10:03.162093 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:10:03.162157 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:10:03.469961 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:10:04.875520 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:10:04.875623 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:10:04.875699 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:10:04.875768 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:10:04.875829 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:10:04.875895 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:10:04.875961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:10:05.184759 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:10:33.738819 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:10:33.738925 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:10:33.739016 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:10:33.739097 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:10:33.739186 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:10:33.739276 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:10:33.739355 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:10:34.045965 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:10:35.449781 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:10:35.449891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:10:35.449970 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:10:35.450038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:10:35.450104 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:10:35.450175 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:10:35.450243 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:10:35.760050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:10:59.170360 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:10:59.170446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:10:59.170528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:10:59.170602 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:10:59.170727 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:10:59.170810 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:10:59.170887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:10:59.477192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:11:04.313106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:11:04.313195 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:11:04.313260 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:11:04.313324 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:11:04.313402 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:11:04.313470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:11:04.313531 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:11:04.620125 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:11:06.021386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:11:06.021486 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:11:06.021547 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:11:06.021612 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:11:06.021680 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:11:06.021752 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:11:06.021812 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:11:06.329269 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:11:34.882970 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:11:34.883073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:11:34.883151 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:11:34.883229 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:11:34.883310 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:11:34.883399 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:11:34.883473 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:11:35.192128 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:11:36.589983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:11:36.590081 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:11:36.590164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:11:36.590242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:11:36.590331 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:11:36.590412 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:11:36.590491 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:11:36.894970 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:11:59.282797 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:11:59.282876 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:11:59.282947 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:11:59.283021 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:11:59.283091 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:11:59.283154 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:11:59.283214 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:11:59.599140 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:12:05.453023 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:12:05.453430 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:12:05.454435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:12:05.454910 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:12:05.454996 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:12:05.455077 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:12:05.455162 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:12:05.763483 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:12:07.156636 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:12:07.156751 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:12:07.156814 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:12:07.156878 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:12:07.156941 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:12:07.157005 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:12:07.157075 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:12:07.459329 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:12:36.025811 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:12:36.025912 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:12:36.025977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:12:36.026039 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:12:36.026102 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:12:36.026165 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:12:36.026223 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:12:36.328698 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:12:37.721170 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:12:37.721280 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:12:37.721338 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:12:37.721408 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:12:37.721472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:12:37.721538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:12:37.721598 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:12:38.023933 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:12:59.401791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:12:59.401876 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:12:59.401939 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:12:59.402005 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:12:59.402071 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:12:59.402137 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:12:59.402199 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:12:59.723567 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:13:06.588077 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:13:06.588166 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:13:06.588243 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:13:06.588302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:13:06.588368 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:13:06.588433 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:13:06.588495 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:13:06.895273 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:13:08.286311 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:13:08.286400 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:13:08.286476 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:13:08.286540 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:13:08.286606 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:13:08.287475 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:13:08.287864 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:13:08.592966 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:13:37.157944 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:13:37.158042 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:13:37.158102 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:13:37.158169 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:13:37.158230 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:13:37.158294 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:13:37.158356 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:13:37.465924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:13:38.859104 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:13:38.859188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:13:38.859268 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:13:38.859342 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:13:38.859408 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:13:38.859467 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:13:38.859525 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:13:39.169394 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:13:59.521145 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:13:59.521246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:13:59.521331 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:13:59.521416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:13:59.521490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:13:59.521565 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:13:59.521642 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:13:59.832959 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:14:07.728835 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:14:07.728943 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:14:07.729005 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:14:07.729078 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:14:07.729151 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:14:07.729219 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:14:07.729297 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:14:08.037698 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:14:09.435196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:14:09.435315 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:14:09.435392 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:14:09.435471 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:14:09.435554 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:14:09.435626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:14:09.435700 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:14:09.742624 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:14:38.300613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:14:38.300739 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:14:38.300833 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:14:38.300919 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:14:38.301003 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:14:38.301082 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:14:38.301164 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:14:38.605444 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:14:40.007654 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:14:40.007755 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:14:40.007835 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:14:40.007912 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:14:40.007986 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:14:40.008060 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:14:40.008132 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:14:40.321980 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:14:59.644580 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:14:59.644656 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:14:59.644732 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:14:59.644795 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:14:59.644858 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:14:59.644919 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:14:59.644982 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:14:59.953500 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:15:08.868536 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:15:08.868657 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:15:08.868745 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:15:08.868820 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:15:08.868901 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:15:08.868978 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:15:08.869054 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:15:09.185103 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:15:10.584403 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:15:10.584500 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:15:10.584578 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:15:10.584649 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:15:10.584729 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:15:10.584796 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:15:10.584862 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:15:10.887100 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:15:39.453460 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:15:39.453582 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:15:39.454153 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:15:39.454674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:15:39.454857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:15:39.454985 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:15:39.455329 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:15:39.767942 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:15:41.147213 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:15:41.147286 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:15:41.147358 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:15:41.147426 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:15:41.147486 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:15:41.147547 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:15:41.147610 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:15:41.458758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:15:59.766325 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:15:59.766401 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:15:59.766487 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:15:59.766549 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:15:59.766612 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:15:59.766675 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:15:59.766753 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:16:00.086232 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:16:10.027819 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:16:10.027918 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:16:10.027994 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:16:10.028064 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:16:10.028137 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:16:10.028199 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:16:10.028260 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:16:10.332921 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:16:11.718971 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:16:11.719054 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:16:11.719136 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:16:11.719193 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:16:11.719255 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:16:11.719333 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:16:11.719396 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:16:12.027056 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:16:40.594622 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:16:40.594704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:16:40.594796 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:16:40.594861 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:16:40.594930 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:16:40.594991 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:16:40.595055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:16:40.895465 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:16:42.296849 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:16:42.296929 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:16:42.297001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:16:42.297061 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:16:42.297126 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:16:42.297179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:16:42.297236 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:16:42.598457 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:16:59.892609 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:16:59.892686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:16:59.892758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:16:59.892824 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:16:59.892881 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:16:59.892941 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:16:59.893001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:17:00.215081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:17:11.161500 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:17:11.161658 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:17:11.161735 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:17:11.161839 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:17:11.161936 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:17:11.162004 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:17:11.162067 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:17:11.475228 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:17:12.863103 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:17:12.863184 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:17:12.863248 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:17:12.863314 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:17:12.863379 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:17:12.863440 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:17:12.863497 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:17:13.176998 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:17:41.736943 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:17:41.737030 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:17:41.737099 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:17:41.737164 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:17:41.737232 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:17:41.737291 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:17:41.737355 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:17:42.056543 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:17:43.439954 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:17:43.440038 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:17:43.440117 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:17:43.440178 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:17:43.440248 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:17:43.440309 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:17:43.440374 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:17:43.750965 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:18:00.022941 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:18:00.023038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:18:00.023107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:18:00.023222 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:18:00.023295 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:18:00.023366 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:18:00.023456 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:18:00.342634 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:18:12.329748 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:18:12.329852 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:18:12.329920 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:18:12.329984 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:18:12.330055 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:18:12.330119 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:18:12.330187 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:18:12.631065 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:18:14.024074 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:18:14.024172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:18:14.024257 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:18:14.024338 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:18:14.024424 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:18:14.024502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:18:14.024585 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:18:14.336918 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:18:42.898662 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:18:42.898772 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:18:42.898833 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:18:42.898906 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:18:42.898979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:18:42.899047 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:18:42.899119 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:18:43.210800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:18:44.599708 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:18:44.599825 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:18:44.599896 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:18:44.599959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:18:44.600018 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:18:44.600075 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:18:44.600138 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:18:44.910426 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:19:00.146393 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:19:00.146475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:19:00.146548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:19:00.146610 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:19:00.146679 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:19:00.146751 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:19:00.146813 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:19:00.460130 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 18:19:13.470681 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:19:13.470780 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:19:13.470848 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:19:13.470910 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:19:13.470972 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:19:13.471038 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:19:13.471097 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:19:13.781795 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:19:15.175246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:19:15.175329 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:19:15.175411 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:19:15.175470 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:19:15.175529 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:19:15.175587 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:19:15.175648 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:19:15.480159 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:19:44.046795 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:19:44.046888 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:19:44.046958 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:19:44.047022 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:19:44.047088 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:19:44.047151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:19:44.047220 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:19:44.352364 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:19:45.746834 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:19:45.746919 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:19:45.746994 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:19:45.747057 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:19:45.747118 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:19:45.747186 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:19:45.747241 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:19:46.047534 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:20:00.276535 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:20:00.276617 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:20:00.276687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:20:00.276763 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:20:00.276827 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:20:00.276893 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:20:00.276954 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:20:00.592941 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:20:14.619144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:20:14.619233 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:20:14.619307 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:20:14.619375 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:20:14.619442 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:20:14.619509 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:20:14.619574 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:20:14.918949 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:20:16.306276 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:20:16.306353 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:20:16.306416 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:20:16.306481 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:20:16.306539 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:20:16.306601 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:20:16.306659 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:20:16.608528 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:20:45.178102 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:20:45.178207 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:20:45.178285 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:20:45.178370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:20:45.178436 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:20:45.178501 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:20:45.178568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:20:45.483405 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:20:46.865995 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:20:46.866098 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:20:46.866164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:20:46.866224 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:20:46.866284 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:20:46.866349 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:20:46.866420 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:20:47.173817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:21:00.406086 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:21:00.406166 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:21:00.406236 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:21:00.406298 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:21:00.406361 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:21:00.406424 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:21:00.406487 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:21:00.717895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:21:15.744554 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:21:15.744658 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:21:15.744726 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:21:15.744789 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:21:15.744853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:21:15.744916 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:21:15.744981 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:21:16.050886 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:21:17.431752 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:21:17.432802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:21:17.432954 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:21:17.433087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:21:17.433227 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:21:17.433699 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:21:17.434547 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:21:17.746563 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:21:46.315961 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:21:46.316042 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:21:46.316119 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:21:46.316181 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:21:46.316248 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:21:46.316309 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:21:46.316375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:21:46.622202 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:21:48.016463 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:21:48.016560 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:21:48.016623 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:21:48.016687 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:21:48.016753 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:21:48.016817 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:21:48.016880 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:21:48.331216 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:22:00.530527 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:22:00.530605 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:22:00.530683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:22:00.530754 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:22:00.530822 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:22:00.530887 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:22:00.530961 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:22:00.840424 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:22:16.882211 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:22:16.882322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:22:16.882390 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:22:16.882453 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:22:16.882510 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:22:16.882563 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:22:16.882630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:22:17.186731 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:22:18.594812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:22:18.594897 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:22:18.594962 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:22:18.595024 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:22:18.595086 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:22:18.595146 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:22:18.595205 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:22:18.903738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:22:47.453957 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:22:47.454721 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:22:47.454874 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:22:47.454970 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:22:47.455039 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:22:47.455106 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:22:47.455179 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:22:47.770236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:22:49.164412 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:22:49.164496 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:22:49.164573 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:22:49.164642 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:22:49.164706 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:22:49.164778 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:22:49.164839 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:22:49.470885 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:23:00.651861 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:23:00.651945 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:23:00.652007 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:23:00.652071 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:23:00.652133 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:23:00.652198 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:23:00.652257 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:23:00.955312 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:23:18.034674 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:23:18.034780 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:23:18.034848 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:23:18.034919 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:23:18.034986 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:23:18.035043 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:23:18.035107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:23:18.344220 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:23:19.730494 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:23:19.730590 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:23:19.730659 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:23:19.730722 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:23:19.730787 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:23:19.730848 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:23:19.730910 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:23:20.044379 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:23:48.606543 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:23:48.606629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:23:48.606705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:23:48.606771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:23:48.606840 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:23:48.606899 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:23:48.606961 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:23:48.919334 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:23:50.310049 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:23:50.310127 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:23:50.311094 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:23:50.311270 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:23:50.311452 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:23:50.311593 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:23:50.311744 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:23:50.619025 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:24:00.777644 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:24:00.777776 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:24:00.777856 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:24:00.777938 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:24:00.778016 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:24:00.778096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:24:00.778170 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:24:01.078913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:24:19.183971 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:24:19.184060 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:24:19.184131 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:24:19.184199 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:24:19.184272 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:24:19.184343 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:24:19.184415 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:24:19.493859 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:24:20.882330 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:24:20.882414 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:24:20.882488 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:24:20.882557 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:24:20.882623 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:24:20.882683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:24:20.882760 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:24:21.183900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:24:49.764617 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:24:49.764712 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:24:49.764783 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:24:49.764848 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:24:49.764902 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:24:49.764970 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:24:49.765031 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:24:50.083823 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:24:51.441542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:24:51.441631 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:24:51.441695 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:24:51.441789 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:24:51.441860 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:24:51.441926 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:24:51.441983 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:24:51.755585 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:25:00.901985 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:25:00.902434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:25:00.902836 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:25:00.903343 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:25:00.903422 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:25:00.903509 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:25:00.903577 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:25:01.212385 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:25:20.343953 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:25:20.344033 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:25:20.344102 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:25:20.344162 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:25:20.344228 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:25:20.344290 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:25:20.344357 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:25:20.640409 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:25:22.018936 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:25:22.019017 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:25:22.019094 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:25:22.019158 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:25:22.019221 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:25:22.019284 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:25:22.019349 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:25:22.338885 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:25:50.899260 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:25:50.899360 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:25:50.899422 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:25:50.899482 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:25:50.899549 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:25:50.899611 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:25:50.899673 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:25:51.202736 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:25:52.594969 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:25:52.595064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:25:52.595122 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:25:52.595183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:25:52.595247 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:25:52.595305 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:25:52.595371 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:25:52.898737 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:26:01.027620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:26:01.027712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:26:01.027789 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:26:01.027854 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:26:01.027923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:26:01.028009 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:26:01.028082 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:26:01.335168 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:26:21.460075 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:26:21.460169 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:26:21.460234 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:26:21.460294 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:26:21.460357 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:26:21.460419 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:26:21.460481 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:26:21.765131 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:26:23.159654 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:26:23.159733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:26:23.159809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:26:23.159874 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:26:23.159936 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:26:23.159998 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:26:23.160060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:26:23.464535 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:26:52.027736 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:26:52.027820 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:26:52.027887 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:26:52.027946 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:26:52.028016 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:26:52.028075 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:26:52.028136 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:26:52.344058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:26:53.726044 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:26:53.726156 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:26:53.726223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:26:53.726286 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:26:53.726362 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:26:53.726422 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:26:53.726483 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:26:54.040686 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:27:01.152546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:27:01.152626 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:27:01.152689 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:27:01.152759 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:27:01.152824 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:27:01.152882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:27:01.152952 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:27:01.463314 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:27:22.608014 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:27:22.608098 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:27:22.608164 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:27:22.608226 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:27:22.608295 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:27:22.609026 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:27:22.609319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:27:22.916429 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:27:24.312062 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:27:24.312148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:27:24.312226 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:27:24.312289 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:27:24.312358 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:27:24.312416 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:27:24.312478 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:27:24.622140 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:27:53.178289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:27:53.178368 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:27:53.178450 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:27:53.178513 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:27:53.178574 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:27:53.178635 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:27:53.178700 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:27:53.495416 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:27:54.884457 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:27:54.884540 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:27:54.884609 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:27:54.884673 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:27:54.884749 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:27:54.884813 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:27:54.884879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:27:55.199345 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:28:01.276595 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:28:01.276679 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:28:01.276758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:28:01.276819 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:28:01.276884 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:28:01.276944 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:28:01.277006 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:28:01.581216 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:28:23.758901 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:28:23.758992 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:28:23.759076 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:28:23.759136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:28:23.759197 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:28:23.759256 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:28:23.759322 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:28:24.069277 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:28:25.460618 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:28:25.460738 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:28:25.460815 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:28:25.460883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:28:25.460955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:28:25.461043 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:28:25.461104 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:28:25.768389 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:28:54.332916 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:28:54.332995 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:28:54.333058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:28:54.333128 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:28:54.333191 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:28:54.333252 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:28:54.333308 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:28:54.641740 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:28:56.029361 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:28:56.029452 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:28:56.029514 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:28:56.029583 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:28:56.029650 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:28:56.029722 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:28:56.029781 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:28:56.332674 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:29:01.403766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:29:01.403845 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:29:01.403911 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:29:01.403974 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:29:01.404037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:29:01.404099 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:29:01.404165 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:29:01.715421 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:29:24.903296 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:29:24.903380 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:29:24.903447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:29:24.903507 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:29:24.903570 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:29:24.903639 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:29:24.903699 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:29:25.219737 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:29:26.594943 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:29:26.595025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:29:26.595091 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:29:26.595165 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:29:26.595228 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:29:26.595286 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:29:26.595356 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:29:26.896581 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:29:55.482062 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:29:55.482141 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:29:55.482208 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:29:55.482268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:29:55.482344 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:29:55.482406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:29:55.482472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:29:55.798895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:29:57.160556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:29:57.160662 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:29:57.160753 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:29:57.160835 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:29:57.160916 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:29:57.160996 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:29:57.161070 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:29:57.467091 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:30:01.534759 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:30:01.534867 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:30:01.534937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:30:01.535016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:30:01.535090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:30:01.535172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:30:01.535244 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:30:01.846325 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:30:26.060787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:30:26.060893 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:30:26.060967 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:30:26.061027 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:30:26.061094 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:30:26.061156 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:30:26.061218 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:30:26.373350 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:30:27.727240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:30:27.727322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:30:27.727398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:30:27.727463 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:30:27.727531 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:30:27.727589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:30:27.727657 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:30:28.034475 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:30:56.635270 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:30:56.635428 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:30:56.635751 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:30:56.636162 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:30:56.636240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:30:56.636316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:30:56.636414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:30:56.942252 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:30:58.298541 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:30:58.298636 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:30:58.298706 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:30:58.298833 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:30:58.298953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:30:58.299067 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:30:58.299143 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:30:58.605284 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:31:01.658774 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:31:01.658857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:31:01.658929 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:31:01.659005 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:31:01.659078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:31:01.659148 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:31:01.659220 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:31:01.975742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:31:27.203735 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:31:27.203817 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:31:27.203883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:31:27.203944 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:31:27.204025 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:31:27.204088 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:31:27.204153 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:31:27.505402 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:31:28.872505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:31:28.872588 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:31:28.872653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:31:28.872730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:31:28.872802 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:31:28.872866 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:31:28.872926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:31:29.183465 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:31:57.769498 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:31:57.769579 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:31:57.769645 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:31:57.769707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:31:57.769779 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:31:57.769843 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:31:57.769908 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:31:58.085644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:31:59.448140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:31:59.448242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:31:59.448312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:31:59.448399 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:31:59.448467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:31:59.448541 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:31:59.448616 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:31:59.756486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:32:01.784066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:32:01.784160 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:32:01.784225 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:32:01.784284 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:32:01.784343 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:32:01.784400 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:32:01.784459 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:32:02.097895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:32:28.345443 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:32:28.345542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:32:28.345618 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:32:28.345684 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:32:28.345749 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:32:28.345819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:32:28.345879 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:32:28.652832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:32:30.028668 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:32:30.028760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:32:30.028835 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:32:30.028903 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:32:30.028964 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:32:30.029027 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:32:30.029086 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:32:30.352939 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:32:58.922335 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:32:58.922424 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:32:58.922493 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:32:58.922557 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:32:58.922618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:32:58.922678 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:32:58.922746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:32:59.236673 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:33:00.622683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:33:00.622765 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:33:00.622839 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:33:00.622900 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:33:00.622959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:33:00.623020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:33:00.623083 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:33:00.926492 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:33:01.906626 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:33:01.906728 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:33:01.906825 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:33:01.906895 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:33:01.906973 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:33:01.907049 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:33:01.907121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:33:02.227505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:33:29.493131 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:33:29.493229 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:33:29.493296 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:33:29.493356 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:33:29.493423 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:33:29.493482 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:33:29.493552 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:33:29.796904 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:33:31.191679 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:33:31.191768 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:33:31.191843 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:33:31.191913 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:33:31.191984 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:33:31.192048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:33:31.192108 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:33:31.497034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:34:00.079528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:34:00.079619 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:34:00.079680 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:34:00.079751 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:34:00.079814 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:34:00.079872 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:34:00.079932 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:34:00.387179 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:34:01.766589 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:34:01.766669 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:34:01.766740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:34:01.766815 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:34:01.766879 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:34:01.766938 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:34:01.767008 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:34:02.097759 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:34:02.364656 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:34:02.364758 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:34:02.364840 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:34:02.364914 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:34:02.364986 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:34:02.365058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:34:02.365138 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:34:02.674234 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:34:30.654741 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:34:30.654828 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:34:30.654895 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:34:30.654955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:34:30.655036 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:34:30.655110 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:34:30.655181 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:34:30.961531 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:34:32.365511 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:34:32.365588 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:34:32.365669 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:34:32.365737 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:34:32.365819 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:34:32.365873 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:34:32.365941 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:34:32.671773 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:35:01.227820 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:35:01.227901 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:35:01.227972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:35:01.228051 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:35:01.228117 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:35:01.228176 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:35:01.228239 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:35:01.536561 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:35:02.152615 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:35:02.152693 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:35:02.152768 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:35:02.152831 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:35:02.152895 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:35:02.152955 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:35:02.153015 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:35:02.457921 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:35:02.939650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:35:02.939772 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:35:02.939846 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:35:02.939912 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:35:02.939976 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:35:02.940037 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:35:02.940094 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:35:03.250159 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:35:31.798749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:35:31.798845 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:35:31.798938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:35:31.799019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:35:31.799107 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:35:31.799189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:35:31.799285 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:35:32.114440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:35:33.506520 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:35:33.506652 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:35:33.506753 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:35:33.506850 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:35:33.506948 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:35:33.507046 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:35:33.507153 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:35:33.813132 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:36:02.291928 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:36:02.292063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:36:02.292141 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:36:02.292248 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:36:02.292333 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:36:02.292422 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:36:02.292508 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:36:02.594193 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:36:02.860176 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:36:02.860280 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:36:02.860369 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:36:02.860449 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:36:02.860539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:36:02.860626 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:36:02.860705 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:36:03.165858 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:36:04.078233 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:36:04.078331 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:36:04.078405 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:36:04.078481 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:36:04.078559 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:36:04.078623 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:36:04.078692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:36:04.380658 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:36:32.861363 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:36:32.861457 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:36:32.862113 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:36:32.863156 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:36:32.863809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:36:32.864559 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:36:32.864654 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:36:33.170740 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:36:34.641856 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:36:34.641970 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:36:34.642057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:36:34.642124 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:36:34.642200 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:36:34.642266 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:36:34.642334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:36:34.963745 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:37:02.421458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:37:02.421542 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:37:02.421609 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:37:02.421689 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:37:02.421760 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:37:02.421821 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:37:02.421891 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:37:02.729199 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:37:03.439242 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:37:03.439336 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:37:03.439402 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:37:03.439469 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:37:03.439532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:37:03.439599 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:37:03.439654 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:37:03.740506 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:37:05.228856 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:37:05.228963 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:37:05.229033 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:37:05.229098 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:37:05.229155 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:37:05.229217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:37:05.229275 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:37:05.531699 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:37:33.997892 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:37:33.997997 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:37:33.998076 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:37:33.998153 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:37:33.998228 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:37:33.998307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:37:33.998372 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:37:34.301893 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:37:35.796685 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:37:35.796822 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:37:35.796893 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:37:35.796960 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:37:35.797035 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:37:35.797095 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:37:35.797163 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:37:36.103791 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:38:02.548886 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:38:02.548966 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:38:02.549033 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:38:02.549100 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:38:02.549166 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:38:02.549231 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:38:02.549290 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:38:02.862644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:38:04.563405 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:38:04.563507 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:38:04.563578 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:38:04.563653 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:38:04.563726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:38:04.563794 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:38:04.563856 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:38:04.880412 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:38:06.360731 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:38:06.360816 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:38:06.360899 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:38:06.360965 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:38:06.361023 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:38:06.361091 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:38:06.361151 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:38:06.665196 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:38:35.141076 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:38:35.141157 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:38:35.141231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:38:35.141302 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:38:35.141358 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:38:35.141429 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:38:35.141489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:38:35.451002 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:38:36.927610 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:38:36.927691 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:38:36.927764 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:38:36.927851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:38:36.927916 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:38:36.927979 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:38:36.928040 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:38:37.234003 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:39:02.678204 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:39:02.678328 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:39:02.678390 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:39:02.678451 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:39:02.678513 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:39:02.678575 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:39:02.678638 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:39:02.980783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:39:05.713705 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:39:05.713789 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:39:05.713863 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:39:05.713945 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:39:05.714007 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:39:05.714076 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:39:05.714139 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:39:06.015876 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:39:07.496645 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:39:07.496733 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:39:07.496819 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:39:07.496888 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:39:07.496961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:39:07.497041 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:39:07.497115 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:39:07.805921 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:39:36.281295 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:39:36.281378 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:39:36.281443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:39:36.281504 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:39:36.281568 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:39:36.281626 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:39:36.281684 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:39:36.592282 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:39:38.070648 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:39:38.070748 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:39:38.070811 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:39:38.070874 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:39:38.070934 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:39:38.071010 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:39:38.071063 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:39:38.377707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:40:02.805890 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:40:02.805977 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:40:02.806047 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:40:02.806123 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:40:02.806191 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:40:02.806266 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:40:02.806329 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:40:03.108884 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:40:06.853343 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:40:06.853428 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:40:06.853491 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:40:06.853552 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:40:06.853617 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:40:06.853676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:40:06.853744 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:40:07.155594 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:40:08.640073 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:40:08.640169 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:40:08.640246 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:40:08.640306 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:40:08.640368 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:40:08.640426 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:40:08.640481 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:40:08.941900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:40:37.414740 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:40:37.414829 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:40:37.414903 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:40:37.414967 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:40:37.415031 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:40:37.415085 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:40:37.415153 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:40:37.726040 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:40:39.214905 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:40:39.214995 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:40:39.215077 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:40:39.215151 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:40:39.215216 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:40:39.215295 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:40:39.215361 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:40:39.521751 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:41:02.936104 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:41:02.936595 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:41:02.937574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:41:02.937931 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:41:02.938008 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:41:02.938077 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:41:02.938158 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:41:03.250582 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:41:07.989887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:41:07.989976 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:41:07.990040 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:41:07.990106 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:41:07.990170 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:41:07.990234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:41:07.990295 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:41:08.296098 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:41:09.788369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:41:09.788456 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:41:09.788520 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:41:09.788579 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:41:09.788642 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:41:09.788731 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:41:09.788796 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:41:10.101122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:41:38.559106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:41:38.559230 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:41:38.559316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:41:38.559397 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:41:38.559476 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:41:38.559555 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:41:38.559647 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:41:38.871383 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:41:40.369749 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:41:40.369876 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:41:40.369953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:41:40.370039 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:41:40.370121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:41:40.370201 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:41:40.370274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:41:40.667859 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:42:03.066352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:42:03.066442 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:42:03.066519 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:42:03.066602 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:42:03.066674 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:42:03.066753 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:42:03.066834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:42:03.376600 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:42:09.130799 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:42:09.130892 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:42:09.130972 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:42:09.131039 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:42:09.131104 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:42:09.131164 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:42:09.131250 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:42:09.434252 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:42:10.927344 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:42:10.927434 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:42:10.927503 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:42:10.927590 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:42:10.927656 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:42:10.927741 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:42:10.927815 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:42:11.232195 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:42:39.698489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:42:39.698577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:42:39.698637 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:42:39.698709 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:42:39.698789 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:42:39.698854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:42:39.698914 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:42:40.009048 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:42:41.494055 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:42:41.494139 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:42:41.494218 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:42:41.494285 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:42:41.494345 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:42:41.494413 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:42:41.494478 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:42:41.807120 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:43:03.195539 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:43:03.195614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:43:03.195687 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:43:03.195764 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:43:03.195835 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:43:03.195894 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:43:03.195957 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:43:03.505551 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:43:10.268874 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:43:10.268959 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:43:10.269029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:43:10.269100 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:43:10.269164 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:43:10.269232 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:43:10.269295 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:43:10.575996 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:43:12.089101 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:43:12.089188 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:43:12.089254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:43:12.089321 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:43:12.089383 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:43:12.089450 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:43:12.089512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:43:12.410785 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:43:40.839776 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:43:40.839875 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:43:40.839939 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:43:40.840005 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:43:40.840067 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:43:40.840135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:43:40.840197 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:43:41.150179 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:43:42.675743 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:43:42.675830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:43:42.675894 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:43:42.675960 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:43:42.676022 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:43:42.676087 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:43:42.676150 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:43:42.982704 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:44:03.323740 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:44:03.323858 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:44:03.323950 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:44:03.324026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:44:03.324126 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:44:03.324188 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:44:03.324283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:44:03.632623 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:44:11.414708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:44:11.414842 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:44:11.414953 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:44:11.415063 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:44:11.415162 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:44:11.415247 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:44:11.415344 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:44:11.720312 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:44:13.242234 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:44:13.242334 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:44:13.242424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:44:13.242510 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:44:13.242593 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:44:13.242685 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:44:13.242786 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:44:13.548966 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:44:41.998452 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:44:41.998533 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:44:41.998609 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:44:41.998677 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:44:41.998744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:44:41.998813 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:44:41.998873 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:44:42.311473 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:44:43.808484 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:44:43.808567 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:44:43.808650 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:44:43.808751 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:44:43.808824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:44:43.808903 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:44:43.808983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:44:44.116844 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:45:03.445381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:45:03.445463 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:45:03.445527 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:45:03.445596 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:45:03.445671 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:45:03.445756 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:45:03.445826 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:45:03.757928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:45:12.575211 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:45:12.575343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:45:12.575424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:45:12.575502 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:45:12.575580 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:45:12.575661 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:45:12.575748 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:45:12.874575 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:45:14.381522 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:45:14.381631 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:45:14.381706 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:45:14.381795 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:45:14.381869 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:45:14.381939 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:45:14.382022 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:45:14.685402 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:45:43.136383 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:45:43.136486 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:45:43.136556 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:45:43.136627 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:45:43.136690 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:45:43.136760 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:45:43.136828 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:45:43.440395 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:45:44.951584 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:45:44.951684 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:45:44.951792 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:45:44.951879 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:45:44.951957 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:45:44.952038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:45:44.952120 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:45:45.253962 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:46:03.571737 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:46:03.571837 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:46:03.571910 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:46:03.571990 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:46:03.572063 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:46:03.572137 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:46:03.572209 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:46:03.887929 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:46:13.705482 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:46:13.705617 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:46:13.705695 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:46:13.705786 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:46:13.705859 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:46:13.705937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:46:13.706014 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:46:14.016817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:46:15.514846 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:46:15.514965 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:46:15.515052 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:46:15.515122 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:46:15.515203 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:46:15.515281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:46:15.515357 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:46:15.820710 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:46:44.286708 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:46:44.287117 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:46:44.287327 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:46:44.287598 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:46:44.288364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:46:44.288856 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:46:44.288951 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:46:44.599737 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:46:46.078029 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:46:46.078157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:46:46.078240 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:46:46.078333 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:46:46.078413 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:46:46.078503 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:46:46.078594 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:46:46.382012 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:47:03.694257 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:47:03.694348 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:47:03.694427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:47:03.694508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:47:03.694581 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:47:03.694656 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:47:03.694735 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:47:04.004288 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:47:14.865856 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:47:14.865938 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:47:14.866001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:47:14.866061 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:47:14.866124 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:47:14.866186 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:47:14.866240 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:47:15.178697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:47:16.638546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:47:16.638645 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:47:16.638743 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:47:16.638808 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:47:16.638875 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:47:16.638937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:47:16.638995 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:47:16.945302 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:47:45.438642 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:47:45.438738 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:47:45.438818 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:47:45.438879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:47:45.438939 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:47:45.439003 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:47:45.439061 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:47:45.742557 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:47:47.208827 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:47:47.208946 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:47:47.209022 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:47:47.209097 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:47:47.209176 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:47:47.209248 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:47:47.209324 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:47:47.514904 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:48:03.817288 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:48:03.817395 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:48:03.817474 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:48:03.817560 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:48:03.817640 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:48:03.817725 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:48:03.817805 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:48:04.116479 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:48:16.002990 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:48:16.003080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:48:16.003156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:48:16.003225 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:48:16.003298 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:48:16.003366 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:48:16.003442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:48:16.305848 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:48:17.790276 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:48:17.790376 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:48:17.790450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:48:17.790519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:48:17.790584 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:48:17.790649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:48:17.790714 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:48:18.087191 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:48:46.561490 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:48:46.561585 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:48:46.561653 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:48:46.561723 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:48:46.561792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:48:46.561856 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:48:46.561922 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:48:46.862360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:48:48.340920 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:48:48.341004 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:48:48.341068 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:48:48.341142 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:48:48.341209 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:48:48.341269 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:48:48.341330 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:48:48.643284 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:49:03.944746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:49:03.944835 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:49:03.944922 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:49:03.945025 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:49:03.945106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:49:03.945212 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:49:03.945294 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:49:04.250293 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:49:17.121457 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:49:17.121579 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:49:17.121659 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:49:17.121751 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:49:17.121834 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:49:17.121914 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:49:17.122007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:49:17.418574 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:49:18.902494 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:49:18.902603 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:49:18.902680 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:49:18.902764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:49:18.902836 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:49:18.902912 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:49:18.902983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:49:19.224701 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:49:47.685638 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:49:47.685757 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:49:47.685863 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:49:47.685953 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:49:47.686043 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:49:47.686125 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:49:47.686219 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:49:47.991107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:49:49.490834 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:49:49.490942 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:49:49.491032 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:49:49.491109 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:49:49.491187 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:49:49.491274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:49:49.491346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:49:49.796697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:50:04.066348 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:50:04.066461 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:50:04.066541 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:50:04.066622 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:50:04.066704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:50:04.066802 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:50:04.066882 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:50:04.378364 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:50:18.252197 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:50:18.252282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:50:18.252371 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:50:18.252444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:50:18.252514 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:50:18.252576 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:50:18.252648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:50:18.565468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:50:20.064565 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:50:20.064649 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:50:20.064743 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:50:20.064809 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:50:20.064889 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:50:20.064955 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:50:20.065029 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:50:20.376243 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:50:48.833366 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:50:48.833444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:50:48.833541 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:50:48.833597 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:50:48.833663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:50:48.833731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:50:48.833791 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:50:49.133572 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:50:50.631212 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:50:50.631309 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:50:50.631390 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:50:50.631469 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:50:50.631542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:50:50.631620 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:50:50.631707 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:50:50.933629 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:51:04.193744 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:51:04.193866 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:51:04.193954 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:51:04.194036 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:51:04.194115 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:51:04.194197 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:51:04.194279 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:51:04.498485 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:51:19.417594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:51:19.417693 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:51:19.417787 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:51:19.417877 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:51:19.417944 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:51:19.418013 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:51:19.418072 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:51:19.725976 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:51:21.190132 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:51:21.190211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:51:21.190283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:51:21.190350 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:51:21.190416 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:51:21.190477 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:51:21.190544 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:51:21.499926 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:51:49.989102 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:51:49.989190 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:51:49.989252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:51:49.989317 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:51:49.989392 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:51:49.989455 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:51:49.989512 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:51:50.308730 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:51:51.759105 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:51:51.759193 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:51:51.759272 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:51:51.759341 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:51:51.759401 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:51:51.759468 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:51:51.759528 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:51:52.080812 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:52:04.320048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:52:04.320125 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:52:04.320189 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:52:04.320264 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:52:04.320329 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:52:04.320390 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:52:04.320452 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:52:04.629557 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:52:20.573002 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:52:20.573084 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:52:20.573155 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:52:20.573236 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:52:20.573293 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:52:20.573354 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:52:20.573417 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:52:20.887281 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:52:22.350276 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:52:22.350867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:52:22.350975 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:52:22.351048 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:52:22.351117 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:52:22.351186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:52:22.351254 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:52:22.652329 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:52:51.144021 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:52:51.144107 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:52:51.144181 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:52:51.144253 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:52:51.144321 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:52:51.144384 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:52:51.144442 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:52:51.450300 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:52:52.913318 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:52:52.913406 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:52:52.913474 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:52:52.913545 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:52:52.913606 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:52:52.913671 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:52:52.913742 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:52:53.221245 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:53:04.440673 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:53:04.440768 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:53:04.440838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:53:04.440900 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:53:04.440967 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:53:04.441033 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:53:04.441093 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:53:04.749877 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:53:21.713506 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:53:21.713589 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:53:21.713655 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:53:21.713735 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:53:21.713805 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:53:21.713865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:53:21.713935 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:53:22.031251 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:53:23.482221 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:53:23.482328 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:53:23.482410 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:53:23.482500 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:53:23.482593 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:53:23.482677 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:53:23.482775 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:53:23.786323 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:53:52.320138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:53:52.320222 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:53:52.320288 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:53:52.320362 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:53:52.320426 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:53:52.320496 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:53:52.320561 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:53:52.622960 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:53:54.051634 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:53:54.051721 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:53:54.051795 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:53:54.051855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:53:54.051926 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:53:54.051983 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:53:54.052052 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:53:54.356239 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:54:04.563065 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:54:04.563143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:54:04.563212 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:54:04.563272 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:54:04.563333 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:54:04.563392 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:54:04.563456 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:54:04.881280 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:54:22.880648 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:54:22.880740 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:54:22.880806 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:54:22.880867 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:54:22.880931 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:54:22.880995 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:54:22.881059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:54:23.182641 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:54:24.616600 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:54:24.616687 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:54:24.616771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:54:24.616844 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:54:24.616907 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:54:24.616973 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:54:24.617035 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:54:24.924916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:54:53.443460 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:54:53.443549 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:54:53.443627 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:54:53.443690 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:54:53.443762 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:54:53.443830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:54:53.443896 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:54:53.744874 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:54:55.190764 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:54:55.190849 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:54:55.190915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:54:55.190986 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:54:55.191047 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:54:55.191111 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:54:55.191170 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:54:55.495199 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:55:04.683824 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:55:04.683898 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:55:04.683963 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:55:04.684031 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:55:04.684095 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:55:04.684153 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:55:04.684218 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:55:05.000063 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:55:24.002319 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:55:24.002400 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:55:24.002460 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:55:24.002530 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:55:24.002587 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:55:24.002656 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:55:24.002729 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:55:24.308860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:55:25.762261 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:55:25.762343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:55:25.762413 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:55:25.762475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:55:25.762548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:55:25.762606 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:55:25.762667 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:55:26.070045 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:55:54.569146 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:55:54.569251 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:55:54.569332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:55:54.569400 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:55:54.569477 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:55:54.569548 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:55:54.569620 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:55:54.878838 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:55:56.329971 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:55:56.330059 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:55:56.330126 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:55:56.330195 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:55:56.330260 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:55:56.330324 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:55:56.330381 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:55:56.634121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:56:04.819841 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:56:04.819929 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:56:04.819997 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:56:04.820064 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:56:04.820122 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:56:04.820182 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:56:04.820246 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:56:05.129758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:56:25.145926 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:56:25.146049 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:56:25.146138 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:56:25.146213 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:56:25.146289 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:56:25.146369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:56:25.146442 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:56:25.454117 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:56:26.896634 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:56:26.896749 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:56:26.896836 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:56:26.896921 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:56:26.896997 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:56:26.897074 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:56:26.897150 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:56:27.204566 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:56:55.711039 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:56:55.711144 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:56:55.711221 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:56:55.711294 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:56:55.711360 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:56:55.711435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:56:55.711500 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:56:56.018404 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:56:57.463260 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:56:57.464136 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:56:57.464251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:56:57.464327 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:56:57.464398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:56:57.464476 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:56:57.464544 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:56:57.773974 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:57:04.949316 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:57:04.949394 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:57:04.949460 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:57:04.949522 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:57:04.949592 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:57:04.949651 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:57:04.949713 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:57:05.257986 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:57:26.282881 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:57:26.282982 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:57:26.283059 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:57:26.283133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:57:26.283208 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:57:26.283284 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:57:26.283358 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:57:26.592451 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:57:28.032091 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:57:28.032189 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:57:28.032271 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:57:28.032343 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:57:28.032419 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:57:28.032493 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:57:28.032577 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:57:28.350984 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:57:56.854733 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:57:56.854833 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:57:56.854910 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:57:56.854986 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:57:56.855075 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:57:56.855157 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:57:56.855239 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:57:57.161988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:57:58.623393 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:57:58.623492 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:57:58.623569 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:57:58.623641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:57:58.623729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:57:58.623804 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:57:58.623881 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:57:58.928015 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:58:05.068402 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:58:05.068505 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:58:05.068572 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:58:05.068649 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:58:05.068740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:58:05.068817 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:58:05.068888 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:58:05.369540 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:58:27.426214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:58:27.426319 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:58:27.426394 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:58:27.426477 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:58:27.426547 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:58:27.426629 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:58:27.426708 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:58:27.732852 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:58:29.192923 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:58:29.193028 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:58:29.193107 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:58:29.193178 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:58:29.193257 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:58:29.193341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:58:29.193416 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:58:29.504183 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:58:57.989483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:58:57.989580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:58:57.989659 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:58:57.989741 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:58:57.989845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:58:57.989919 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:58:57.989995 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:58:58.292434 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:58:59.764473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:58:59.764576 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:58:59.764654 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:58:59.764737 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:58:59.764806 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:58:59.764885 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:58:59.764959 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:59:00.086414 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:59:05.188320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:59:05.188429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:59:05.188524 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:59:05.188625 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:59:05.188700 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:59:05.188780 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:59:05.188858 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:59:05.487253 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:59:28.552247 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:59:28.552334 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:59:28.552403 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:59:28.552474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:59:28.552543 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:59:28.552603 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:59:28.552686 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:59:28.858304 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:59:30.356302 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:59:30.356383 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:59:30.356455 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:59:30.356524 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:59:30.356592 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:59:30.356657 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:59:30.356734 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:59:30.655800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 18:59:59.124296 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 18:59:59.124383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 18:59:59.124452 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 18:59:59.124520 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 18:59:59.124591 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 18:59:59.124662 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 18:59:59.124742 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 18:59:59.442446 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:00:00.911383 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:00:00.911469 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:00:00.911543 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:00:00.911622 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:00:00.911689 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:00:00.911759 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:00:00.911830 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:00:01.221530 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:00:05.307920 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:00:05.308002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:00:05.308075 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:00:05.308140 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:00:05.308200 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:00:05.308282 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:00:05.308347 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:00:05.617793 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:00:29.706429 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:00:29.706966 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:00:29.707324 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:00:29.707546 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:00:29.708304 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:00:29.709114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:00:29.709211 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:00:30.026443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:00:31.484950 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:00:31.485032 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:00:31.485111 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:00:31.485174 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:00:31.485237 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:00:31.485301 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:00:31.485367 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:00:31.789741 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:01:00.301660 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:01:00.301772 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:01:00.301848 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:01:00.301940 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:01:00.302017 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:01:00.302097 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:01:00.302188 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:01:00.612146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:01:02.089543 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:01:02.089637 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:01:02.089712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:01:02.089786 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:01:02.089859 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:01:02.089925 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:01:02.090007 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:01:02.402035 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:01:05.429987 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:01:05.430070 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:01:05.430139 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:01:05.430202 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:01:05.430267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:01:05.430327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:01:05.430398 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:01:05.739503 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:01:30.880667 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:01:30.880793 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:01:30.880872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:01:30.880946 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:01:30.881023 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:01:30.881105 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:01:30.881188 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:01:31.190937 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:01:32.665067 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:01:32.665157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:01:32.665227 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:01:32.665300 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:01:32.665371 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:01:32.665437 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:01:32.665503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:01:32.972066 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:02:01.459419 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:02:01.459509 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:02:01.459577 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:02:01.459637 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:02:01.459697 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:02:01.459768 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:02:01.459835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:02:01.769569 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:02:03.237989 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:02:03.238096 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:02:03.238161 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:02:03.238226 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:02:03.238296 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:02:03.238353 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:02:03.238421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:02:03.543442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:02:05.553035 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:02:05.553116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:02:05.553175 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:02:05.553236 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:02:05.553303 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:02:05.553364 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:02:05.553425 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:02:05.858236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:02:32.036018 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:02:32.036104 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:02:32.036171 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:02:32.036235 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:02:32.036301 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:02:32.036360 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:02:32.036430 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:02:32.351454 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:02:33.811270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:02:33.811354 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:02:33.811432 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:02:33.811496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:02:33.811561 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:02:33.812396 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:02:33.812703 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:02:34.119463 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:03:02.613454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:03:02.613535 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:03:02.613607 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:03:02.613673 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:03:02.613745 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:03:02.613808 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:03:02.613874 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:03:02.915651 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:03:04.398435 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:03:04.398537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:03:04.398605 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:03:04.398670 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:03:04.398741 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:03:04.398799 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:03:04.398860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:03:04.706899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:03:05.678653 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:03:05.678738 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:03:05.678806 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:03:05.678868 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:03:05.678927 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:03:05.678994 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:03:05.679052 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:03:05.984905 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:03:33.179993 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:03:33.180081 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:03:33.180158 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:03:33.180228 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:03:33.180291 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:03:33.180356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:03:33.180424 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:03:33.484481 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:03:34.971889 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:03:34.971980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:03:34.972057 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:03:34.972127 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:03:34.972192 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:03:34.972259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:03:34.972318 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:03:35.274181 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:04:03.749559 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:04:03.750258 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:04:03.750346 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:04:03.750439 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:04:03.750498 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:04:03.750563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:04:03.750627 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:04:04.060645 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:04:05.530545 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:04:05.530628 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:04:05.530707 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:04:05.530781 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:04:05.530845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:04:05.530909 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:04:05.530968 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:04:05.842554 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:04:06.104438 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:04:06.104581 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:04:06.104648 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:04:06.104732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:04:06.104811 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:04:06.104880 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:04:06.104945 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:04:06.413084 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:04:34.323968 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:04:34.324071 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:04:34.324164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:04:34.324236 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:04:34.324314 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:04:34.324389 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:04:34.324473 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:04:34.630977 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:04:36.105781 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:04:36.105900 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:04:36.105977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:04:36.106049 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:04:36.106118 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:04:36.106187 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:04:36.106254 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:04:36.408589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:05:04.902045 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:05:04.902149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:05:04.902215 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:05:04.902277 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:05:04.902341 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:05:04.902395 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:05:04.902459 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:05:05.209634 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:05:05.924619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:05:05.925073 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:05:05.925817 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:05:05.925939 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:05:05.926025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:05:05.926104 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:05:05.926182 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:05:06.230758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:05:06.672306 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:05:06.672406 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:05:06.672493 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:05:06.672576 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:05:06.672650 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:05:06.672712 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:05:06.672785 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:05:06.981212 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:05:35.478262 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:05:35.478365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:05:35.478435 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:05:35.478503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:05:35.478575 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:05:35.478643 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:05:35.478712 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:05:35.781185 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:05:37.246245 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:05:37.246359 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:05:37.246438 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:05:37.246524 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:05:37.246598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:05:37.246677 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:05:37.246756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:05:37.551281 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:06:06.038960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:06:06.039045 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:06:06.039117 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:06:06.039179 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:06:06.039254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:06:06.039322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:06:06.039393 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:06:06.342813 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:06:06.607667 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:06:06.607754 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:06:06.607829 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:06:06.607904 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:06:06.607970 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:06:06.608036 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:06:06.608111 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:06:06.907426 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:06:07.812310 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:06:07.812746 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:06:07.813504 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:06:07.813595 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:06:07.813669 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:06:07.813750 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:06:07.813824 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:06:08.116638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:06:36.610232 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:06:36.610326 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:06:36.610413 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:06:36.610491 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:06:36.610582 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:06:36.610661 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:06:36.610744 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:06:36.919893 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:06:38.382403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:06:38.382492 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:06:38.382569 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:06:38.382645 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:06:38.382727 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:06:38.382800 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:06:38.382882 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:06:38.687506 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:07:06.171496 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:07:06.171606 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:07:06.171680 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:07:06.171757 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:07:06.171835 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:07:06.171905 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:07:06.171975 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:07:06.479342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:07:07.185912 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:07:07.186026 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:07:07.186104 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:07:07.186180 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:07:07.186264 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:07:07.186337 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:07:07.186412 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:07:07.490050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:07:08.950384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:07:08.950484 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:07:08.950564 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:07:08.950643 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:07:08.950722 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:07:08.950790 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:07:08.950867 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:07:09.252614 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:07:37.759815 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:07:37.759927 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:07:37.759999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:07:37.760069 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:07:37.760146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:07:37.760210 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:07:37.760289 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:07:38.064024 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:07:39.514775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:07:39.514861 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:07:39.514932 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:07:39.514993 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:07:39.515064 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:07:39.515122 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:07:39.515186 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:07:39.824566 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:08:06.296819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:08:06.296894 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:08:06.296966 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:08:06.297029 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:08:06.297095 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:08:06.297160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:08:06.297223 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:08:06.602094 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:08:08.317217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:08:08.317307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:08:08.317381 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:08:08.317445 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:08:08.317508 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:08:08.317571 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:08:08.317634 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:08:08.616967 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:08:10.100511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:08:10.100591 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:08:10.100659 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:08:10.100732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:08:10.100802 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:08:10.100871 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:08:10.100933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:08:10.407812 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:08:38.877974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:08:38.878078 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:08:38.878155 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:08:38.878221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:08:38.878282 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:08:38.878356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:08:38.878410 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:08:39.186900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:08:40.665463 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:08:40.665562 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:08:40.665626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:08:40.665697 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:08:40.665771 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:08:40.665842 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:08:40.665905 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:08:40.974560 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:09:06.426319 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:09:06.426433 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:09:06.426518 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:09:06.426600 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:09:06.426680 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:09:06.426762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:09:06.426836 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:09:06.728171 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:09:09.447580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:09:09.447690 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:09:09.447779 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:09:09.447853 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:09:09.447923 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:09:09.447998 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:09:09.448062 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:09:09.754310 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:09:11.235884 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:09:11.235998 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:09:11.236098 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:09:11.236174 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:09:11.236267 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:09:11.236344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:09:11.236425 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:09:11.544103 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:09:40.015011 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:09:40.015111 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:09:40.015195 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:09:40.015270 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:09:40.015345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:09:40.015413 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:09:40.015510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:09:40.333274 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:09:41.825272 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:09:41.825382 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:09:41.825490 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:09:41.825575 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:09:41.825642 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:09:41.825726 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:09:41.825801 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:09:42.149221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:10:06.546652 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:10:06.546748 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:10:06.546821 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:10:06.546890 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:10:06.546954 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:10:06.547024 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:10:06.547095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:10:06.854092 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:10:10.596344 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:10:10.596444 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:10:10.596514 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:10:10.596578 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:10:10.596664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:10:10.596737 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:10:10.596802 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:10:10.913586 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:10:12.410808 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:10:12.410887 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:10:12.410961 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:10:12.411020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:10:12.411082 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:10:12.411144 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:10:12.411208 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:10:12.718178 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:10:41.175723 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:10:41.175816 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:10:41.175885 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:10:41.175956 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:10:41.176020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:10:41.176096 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:10:41.176155 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:10:41.481070 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:10:42.984036 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:10:42.984169 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:10:42.984233 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:10:42.984310 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:10:42.984372 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:10:42.984437 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:10:42.984507 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:10:43.286180 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:11:06.667908 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:11:06.667994 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:11:06.668058 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:11:06.668131 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:11:06.668197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:11:06.668263 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:11:06.668323 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:11:06.977234 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:11:11.742274 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:11:11.742365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:11:11.742431 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:11:11.742503 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:11:11.742568 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:11:11.742641 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:11:11.742713 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:11:12.047300 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:11:13.546665 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:11:13.546765 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:11:13.546843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:11:13.546908 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:11:13.546974 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:11:13.547038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:11:13.547098 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:11:13.848686 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:11:42.305018 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:11:42.305102 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:11:42.305180 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:11:42.305246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:11:42.305311 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:11:42.305376 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:11:42.305444 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:11:42.611906 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:11:44.114904 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:11:44.115015 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:11:44.115071 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:11:44.115133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:11:44.115200 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:11:44.115268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:11:44.115333 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:11:44.430918 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:12:06.791600 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:12:06.791678 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:12:06.791754 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:12:06.791814 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:12:06.791883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:12:06.791944 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:12:06.792009 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:12:07.103454 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:12:12.875507 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:12:12.875590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:12:12.875683 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:12:12.875769 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:12:12.875840 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:12:12.875912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:12:12.875972 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:12:13.181044 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:12:14.695447 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:12:14.695563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:12:14.695639 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:12:14.695708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:12:14.695772 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:12:14.695833 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:12:14.695900 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:12:14.999417 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:12:43.441501 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:12:43.441592 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:12:43.441654 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:12:43.441731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:12:43.441792 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:12:43.441859 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:12:43.441920 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:12:43.751898 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:12:45.264599 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:12:45.264686 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:12:45.264760 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:12:45.264822 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:12:45.264897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:12:45.264963 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:12:45.265029 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:12:45.567933 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:13:06.911825 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:13:06.911904 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:13:06.911976 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:13:06.912046 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:13:06.912114 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:13:06.912178 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:13:06.912240 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:13:07.216157 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:13:14.019040 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:13:14.019130 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:13:14.019195 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:13:14.019268 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:13:14.019333 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:13:14.019402 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:13:14.019463 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:13:14.335749 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:13:15.829972 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:13:15.830071 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:13:15.830152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:13:15.830228 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:13:15.830327 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:13:15.830402 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:13:15.830479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:13:16.129062 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:13:44.597918 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:13:44.598001 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:13:44.598079 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:13:44.598155 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:13:44.598226 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:13:44.598295 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:13:44.598365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:13:44.908242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:13:46.384068 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:13:46.384172 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:13:46.384235 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:13:46.384305 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:13:46.384366 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:13:46.384428 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:13:46.384492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:13:46.692382 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:14:07.034115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:14:07.034238 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:14:07.034322 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:14:07.034413 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:14:07.034493 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:14:07.034582 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:14:07.034653 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:14:07.331664 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:14:15.168628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:14:15.168737 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:14:15.168838 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:14:15.168919 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:14:15.169043 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:14:15.169121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:14:15.169196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:14:15.476044 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:14:16.956177 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:14:16.956278 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:14:16.956344 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:14:16.956412 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:14:16.956473 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:14:16.956545 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:14:16.956605 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:14:17.260529 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:14:45.740346 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:14:45.740436 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:14:45.740504 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:14:45.740569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:14:45.740640 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:14:45.740703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:14:45.740775 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:14:46.044565 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:14:47.519961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:14:47.520055 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:14:47.520139 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:14:47.520218 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:14:47.520292 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:14:47.520361 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:14:47.520445 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:14:47.835536 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:15:07.164873 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:15:07.164988 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:15:07.165068 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:15:07.165153 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:15:07.165235 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:15:07.165313 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:15:07.165385 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:15:07.467700 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:15:16.300510 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:15:16.300609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:15:16.300685 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:15:16.300796 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:15:16.300874 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:15:16.300955 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:15:16.301024 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:15:16.601897 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:15:18.104621 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:15:18.104750 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:15:18.104834 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:15:18.104919 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:15:18.104995 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:15:18.105065 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:15:18.105135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:15:18.407553 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:15:46.866639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:15:46.866744 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:15:46.866809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:15:46.866886 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:15:46.866948 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:15:46.867014 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:15:46.867082 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:15:47.176515 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:15:48.672951 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:15:48.673064 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:15:48.673129 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:15:48.673196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:15:48.673264 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:15:48.673332 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:15:48.673388 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:15:48.988299 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:16:07.292847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:16:07.292934 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:16:07.293002 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:16:07.293074 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:16:07.293141 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:16:07.293217 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:16:07.293273 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:16:07.593052 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:16:17.436129 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:16:17.436214 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:16:17.436285 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:16:17.436357 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:16:17.436413 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:16:17.436479 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:16:17.436539 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:16:17.749869 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:16:19.251744 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:16:19.251827 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:16:19.251896 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:16:19.251955 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:16:19.252023 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:16:19.252088 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:16:19.252148 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:16:19.552435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:16:48.010363 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:16:48.010469 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:16:48.010544 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:16:48.010636 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:16:48.010709 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:16:48.010817 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:16:48.010894 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:16:48.321715 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:16:49.825053 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:16:49.825152 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:16:49.825241 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:16:49.825322 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:16:49.825401 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:16:49.825475 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:16:49.825556 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:16:50.144093 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:17:07.418171 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:17:07.418278 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:17:07.418357 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:17:07.418450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:17:07.418533 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:17:07.418612 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:17:07.418696 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:17:07.723456 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:17:18.587838 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:17:18.587944 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:17:18.588038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:17:18.588116 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:17:18.588194 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:17:18.588297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:17:18.588378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:17:18.894335 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:17:20.407679 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:17:20.407785 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:17:20.407871 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:17:20.407946 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:17:20.408026 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:17:20.408097 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:17:20.408179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:17:20.712742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:17:49.156802 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:17:49.156899 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:17:49.156984 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:17:49.157088 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:17:49.157185 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:17:49.157277 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:17:49.157362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:17:49.464831 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:17:50.973489 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:17:50.973584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:17:50.973655 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:17:50.973742 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:17:50.973813 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:17:50.973890 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:17:50.973962 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:17:51.282326 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:18:07.545080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:18:07.545199 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:18:07.545276 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:18:07.545358 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:18:07.545437 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:18:07.545513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:18:07.545584 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:18:07.849457 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:18:19.726736 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:18:19.726840 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:18:19.726920 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:18:19.726999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:18:19.727068 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:18:19.727142 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:18:19.727213 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:18:20.049175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:18:21.542914 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:18:21.543017 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:18:21.543085 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:18:21.543152 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:18:21.543216 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:18:21.543279 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:18:21.543342 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:18:21.856637 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:18:50.318036 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:18:50.318729 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:18:50.318835 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:18:50.318957 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:18:50.319047 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:18:50.319141 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:18:50.319230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:18:50.623771 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:18:52.120811 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:18:52.120999 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:18:52.121146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:18:52.121295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:18:52.121438 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:18:52.121585 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:18:52.121731 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:18:52.427648 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:19:07.668258 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:19:07.668351 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:19:07.668430 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:19:07.668508 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:19:07.668587 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:19:07.668666 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:19:07.668753 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:19:07.983976 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:19:20.893160 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:19:20.893260 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:19:20.893351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:19:20.893414 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:19:20.893480 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:19:20.893551 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:19:20.893622 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:19:21.205244 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:19:22.682989 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:19:22.683073 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:19:22.683149 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:19:22.683213 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:19:22.683281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:19:22.683341 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:19:22.683407 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:19:23.000494 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:19:51.462738 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:19:51.462823 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:19:51.462884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:19:51.462946 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:19:51.463006 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:19:51.463069 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:19:51.463141 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:19:51.760706 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:19:53.267379 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:19:53.267864 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:19:53.268101 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:19:53.268240 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:19:53.268414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:19:53.269017 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:19:53.269167 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:19:53.574934 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:20:07.795761 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:20:07.795865 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:20:07.795940 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:20:07.796022 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:20:07.796099 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:20:07.796170 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:20:07.796242 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:20:08.105239 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:20:22.022478 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:20:22.022567 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:20:22.022650 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:20:22.022729 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:20:22.022809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:20:22.022891 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:20:22.022964 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:20:22.346857 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:20:23.833874 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:20:23.833987 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:20:23.834072 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:20:23.834160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:20:23.834236 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:20:23.834310 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:20:23.834392 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:20:24.142462 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:20:52.612780 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:20:52.612871 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:20:52.612951 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:20:52.613051 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:20:52.613162 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:20:52.613266 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:20:52.613349 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:20:52.925809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:20:54.411534 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:20:54.411616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:20:54.411688 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:20:54.411777 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:20:54.411851 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:20:54.411916 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:20:54.411974 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:20:54.719855 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:21:07.932231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:21:07.932319 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:21:07.932390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:21:07.932478 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:21:07.932549 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:21:07.932643 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:21:07.932732 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:21:08.232062 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:21:23.186947 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:21:23.187033 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:21:23.187102 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:21:23.187164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:21:23.187236 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:21:23.187297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:21:23.187373 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:21:23.492970 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:21:24.978393 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:21:24.978489 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:21:24.978555 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:21:24.978620 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:21:24.978685 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:21:24.978761 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:21:24.978835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:21:25.290829 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:21:53.755548 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:21:53.755634 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:21:53.755713 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:21:53.755787 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:21:53.755852 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:21:53.755916 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:21:53.755974 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:21:54.067853 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:21:55.552044 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:21:55.552123 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:21:55.552211 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:21:55.552271 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:21:55.552331 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:21:55.552396 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:21:55.552463 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:21:55.862146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:22:08.056554 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:22:08.056634 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:22:08.056702 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:22:08.056797 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:22:08.056857 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:22:08.056932 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:22:08.056989 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:22:08.364360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:22:24.338641 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:22:24.338749 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:22:24.338833 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:22:24.338917 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:22:24.339012 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:22:24.339087 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:22:24.339171 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:22:24.646498 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:22:26.126766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:22:26.126859 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:22:26.126934 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:22:26.127026 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:22:26.127105 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:22:26.127182 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:22:26.127263 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:22:26.431087 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:22:54.911121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:22:54.911237 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:22:54.911311 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:22:54.911390 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:22:54.911462 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:22:54.911531 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:22:54.911590 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:22:55.231747 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:22:56.688267 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:22:56.688350 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:22:56.688414 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:22:56.688481 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:22:56.688541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:22:56.688617 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:22:56.688675 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:22:56.997327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:23:08.183055 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:23:08.183129 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:23:08.183194 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:23:08.183265 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:23:08.183324 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:23:08.183391 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:23:08.183454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:23:08.484689 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:23:25.489300 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:23:25.489384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:23:25.489461 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:23:25.489529 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:23:25.489588 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:23:25.489651 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:23:25.489714 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:23:25.794377 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:23:27.261663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:23:27.261751 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:23:27.261826 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:23:27.261892 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:23:27.261964 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:23:27.262029 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:23:27.262098 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:23:27.569340 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:23:56.056439 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:23:56.056546 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:23:56.056618 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:23:56.056688 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:23:56.056762 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:23:56.056829 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:23:56.056892 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:23:56.363800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:23:57.831687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:23:57.831798 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:23:57.831866 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:23:57.831931 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:23:57.832001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:23:57.832068 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:23:57.832131 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:23:58.138017 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:24:08.317000 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:24:08.317080 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:24:08.317149 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:24:08.317218 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:24:08.317278 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:24:08.317339 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:24:08.317399 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:24:08.624136 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:24:26.617745 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:24:26.617827 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:24:26.617901 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:24:26.617961 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:24:26.618024 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:24:26.618084 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:24:26.618145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:24:26.932736 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:24:28.404633 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:24:28.404743 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:24:28.405920 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:24:28.406428 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:24:28.406659 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:24:28.406991 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:24:28.407604 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:24:28.710367 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:24:57.193200 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:24:57.193303 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:24:57.193380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:24:57.193443 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:24:57.193509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:24:57.193574 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:24:57.193646 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:24:57.497803 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:24:58.992831 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:24:58.992938 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:24:58.993028 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:24:58.993108 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:24:58.993195 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:24:58.993285 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:24:58.993369 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:24:59.299622 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:25:08.449370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:25:08.449457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:25:08.449533 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:25:08.449605 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:25:08.449675 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:25:08.449778 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:25:08.449852 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:25:08.746659 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:25:27.757054 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:25:27.757148 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:25:27.757215 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:25:27.757279 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:25:27.757341 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:25:27.757405 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:25:27.757468 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:25:28.061639 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:25:29.560598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:25:29.560691 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:25:29.560761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:25:29.560829 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:25:29.560896 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:25:29.560964 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:25:29.561020 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:25:29.864668 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:25:58.322530 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:25:58.322622 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:25:58.322689 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:25:58.322767 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:25:58.322835 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:25:58.322898 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:25:58.322963 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:25:58.635059 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:26:00.129147 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:26:00.129246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:26:00.129312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:26:00.129378 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:26:00.129441 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:26:00.129503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:26:00.129572 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:26:00.436973 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:26:08.575503 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:26:08.575588 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:26:08.575653 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:26:08.575721 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:26:08.575788 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:26:08.575846 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:26:08.575921 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:26:08.879800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:26:28.895535 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:26:28.895622 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:26:28.895694 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:26:28.895773 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:26:28.895839 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:26:28.895908 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:26:28.895978 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:26:29.221331 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:26:30.697939 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:26:30.698025 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:26:30.698094 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:26:30.698157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:26:30.698217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:26:30.698284 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:26:30.698352 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:26:31.000831 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:26:59.487733 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:26:59.487843 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:26:59.487973 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:26:59.488086 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:26:59.488167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:26:59.488256 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:26:59.488331 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:26:59.801365 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:27:01.264704 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:27:01.264809 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:27:01.264884 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:27:01.264954 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:27:01.265022 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:27:01.265090 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:27:01.265162 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:27:01.576875 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:27:08.699701 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:27:08.699792 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:27:08.699863 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:27:08.699932 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:27:08.699999 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:27:08.700064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:27:08.700128 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:27:09.012576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:27:30.085331 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:27:30.085414 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:27:30.085492 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:27:30.085554 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:27:30.085618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:27:30.085683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:27:30.085758 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:27:30.395296 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:27:31.846168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:27:31.846267 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:27:31.846332 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:27:31.846394 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:27:31.846454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:27:31.846518 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:27:31.846577 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:27:32.164741 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:28:00.658959 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:28:00.659045 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:28:00.659110 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:28:00.659174 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:28:00.659238 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:28:00.659296 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:28:00.659352 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:28:00.964052 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:28:02.425417 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:28:02.426525 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:28:02.426910 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:28:02.427312 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:28:02.427696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:28:02.427964 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:28:02.428109 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:28:02.730100 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:28:08.827218 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:28:08.827299 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:28:08.827376 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:28:08.827440 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:28:08.827511 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:28:08.827577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:28:08.827651 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:28:09.131337 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:28:31.226654 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:28:31.226792 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:28:31.226860 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:28:31.226932 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:28:31.227000 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:28:31.227062 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:28:31.227143 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:28:31.541912 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:28:32.991558 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:28:32.991646 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:28:32.991725 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:28:32.991797 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:28:32.991866 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:28:32.991929 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:28:32.991993 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:28:33.301493 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:29:01.823453 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:29:01.823557 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:29:01.823634 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:29:01.823724 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:29:01.823802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:29:01.823883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:29:01.823965 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:29:02.140416 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:29:03.567035 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:29:03.567130 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:29:03.567217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:29:03.567289 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:29:03.567369 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:29:03.567451 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:29:03.567528 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:29:03.872916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:29:08.955704 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:29:08.955921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:29:08.956140 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:29:08.956800 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:29:08.956937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:29:08.957023 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:29:08.957140 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:29:09.266673 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:29:32.403400 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:29:32.403519 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:29:32.403598 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:29:32.403699 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:29:32.403796 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:29:32.403882 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:29:32.403966 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:29:32.706195 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:29:34.138459 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:29:34.138545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:29:34.138619 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:29:34.138696 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:29:34.138781 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:29:34.138859 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:29:34.138935 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:29:34.447823 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:30:02.974318 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:30:02.974429 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:30:02.974502 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:30:02.974563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:30:02.974639 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:30:02.974705 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:30:02.974782 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:30:03.279865 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:30:04.715348 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:30:04.715451 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:30:04.715528 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:30:04.715612 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:30:04.715699 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:30:04.715780 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:30:04.715873 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:30:05.022105 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:30:09.082026 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:30:09.082116 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:30:09.082198 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:30:09.082269 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:30:09.082339 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:30:09.082413 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:30:09.082488 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:30:09.393509 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:30:33.541975 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:30:33.542069 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:30:33.542181 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:30:33.542259 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:30:33.542353 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:30:33.542429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:30:33.542498 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:30:33.847357 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:30:35.281403 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:30:35.281501 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:30:35.281568 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:30:35.281635 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:30:35.281700 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:30:35.281771 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:30:35.281834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:30:35.591113 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:31:04.111515 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:31:04.111602 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:31:04.111671 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:31:04.111751 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:31:04.111812 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:31:04.111880 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:31:04.111937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:31:04.442025 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:31:05.857519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:31:05.857604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:31:05.857684 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:31:05.857759 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:31:05.857827 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:31:05.857887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:31:05.857955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:31:06.162336 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:31:09.207797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:31:09.207886 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:31:09.207954 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:31:09.208027 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:31:09.208086 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:31:09.208157 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:31:09.208219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:31:09.522114 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:31:34.699100 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:31:34.699201 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:31:34.699270 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:31:34.699339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:31:34.699396 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:31:34.699463 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:31:34.699517 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:31:35.009833 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:31:36.438779 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:31:36.438884 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:31:36.438966 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:31:36.439044 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:31:36.439116 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:31:36.439195 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:31:36.439263 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:31:36.748197 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:32:05.281460 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:32:05.281567 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:32:05.281639 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:32:05.281711 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:32:05.281783 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:32:05.281854 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:32:05.281913 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:32:05.589507 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:32:07.011761 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:32:07.011855 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:32:07.011945 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:32:07.012022 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:32:07.012095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:32:07.012169 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:32:07.012244 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:32:07.312386 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:32:09.335562 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:32:09.335655 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:32:09.335739 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:32:09.335814 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:32:09.335903 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:32:09.335980 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:32:09.336050 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:32:09.655949 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:32:35.852187 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:32:35.852295 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:32:35.852368 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:32:35.852442 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:32:35.852513 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:32:35.852588 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:32:35.852658 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:32:36.156871 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:32:37.575475 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:32:37.575582 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:32:37.575641 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:32:37.575708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:32:37.575776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:32:37.575835 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:32:37.576881 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:32:37.880015 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:33:06.417230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:33:06.417343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:33:06.417422 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:33:06.417506 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:33:06.417584 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:33:06.417686 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:33:06.417768 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:33:06.718577 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:33:08.140126 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:33:08.140215 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:33:08.140293 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:33:08.140369 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:33:08.140461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:33:08.140532 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:33:08.140612 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:33:08.440221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:33:09.466324 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:33:09.466425 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:33:09.466505 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:33:09.466587 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:33:09.466664 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:33:09.466771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:33:09.466840 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:33:09.767820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:33:36.981992 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:33:36.982084 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:33:36.982166 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:33:36.982246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:33:36.982327 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:33:36.982404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:33:36.982479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:33:37.286078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:33:38.695794 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:33:38.695880 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:33:38.695970 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:33:38.696050 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:33:38.696121 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:33:38.696201 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:33:38.696275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:33:39.001250 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:34:07.546137 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:34:07.546219 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:34:07.546283 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:34:07.546359 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:34:07.546423 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:34:07.546492 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:34:07.546557 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:34:07.852164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:34:09.271165 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:34:09.271246 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:34:09.271316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:34:09.271378 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:34:09.271440 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:34:09.271500 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:34:09.271563 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:34:09.583933 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:34:09.849606 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:34:09.849692 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:34:09.849802 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:34:09.849886 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:34:09.849970 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:34:09.850048 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:34:09.850120 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:34:10.157418 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:34:38.110602 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:34:38.110707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:34:38.110781 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:34:38.110862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:34:38.110944 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:34:38.111017 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:34:38.111087 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:34:38.420138 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:34:39.851166 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:34:39.851281 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:34:39.851360 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:34:39.851439 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:34:39.851516 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:34:39.851604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:34:39.851680 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:34:40.160079 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:35:08.686919 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:35:08.687536 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:35:08.687652 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:35:08.687743 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:35:08.687837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:35:08.687984 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:35:08.688062 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:35:08.995843 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:35:09.713890 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:35:09.713998 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:35:09.714065 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:35:09.714133 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:35:09.714192 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:35:09.714262 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:35:09.714324 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:35:10.020890 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:35:10.424899 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:35:10.424981 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:35:10.425053 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:35:10.425119 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:35:10.425182 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:35:10.425243 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:35:10.425307 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:35:10.734135 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:35:39.260363 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:35:39.260455 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:35:39.260523 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:35:39.260590 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:35:39.260656 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:35:39.260729 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:35:39.260794 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:35:39.563044 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:35:40.998187 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:35:40.998289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:35:40.998380 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:35:40.998479 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:35:40.998551 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:35:40.998629 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:35:40.998699 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:35:41.303846 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:36:09.833792 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:36:09.833905 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:36:09.834007 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:36:09.834117 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:36:09.834217 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:36:09.834322 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:36:09.834427 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:36:10.144655 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:36:10.412893 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:36:10.412985 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:36:10.413067 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:36:10.413149 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:36:10.413249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:36:10.413373 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:36:10.413457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:36:10.712561 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:36:11.570905 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:36:11.571015 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:36:11.571097 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:36:11.571180 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:36:11.571255 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:36:11.571334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:36:11.571416 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:36:11.883209 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:36:40.410194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:36:40.410291 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:36:40.410360 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:36:40.410432 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:36:40.410511 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:36:40.410585 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:36:40.410666 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:36:40.713867 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:36:42.165189 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:36:42.165292 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:36:42.165364 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:36:42.165456 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:36:42.165527 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:36:42.165603 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:36:42.165674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:36:42.478307 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:37:09.974315 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:37:09.974397 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:37:09.974464 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:37:09.974527 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:37:09.974598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:37:09.974656 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:37:09.974728 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:37:10.285758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 19:37:10.972346 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:37:10.972464 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:37:10.972537 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:37:10.972610 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:37:10.972671 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:37:10.972748 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:37:10.972814 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:37:11.273099 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 19:37:12.739190 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:37:12.739282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:37:12.739345 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:37:12.739420 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:37:12.739483 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:37:12.739541 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:37:12.739606 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:37:13.042456 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-23 19:37:41.537741 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:37:41.537858 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:37:41.537944 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:37:41.538004 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:37:41.538086 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:37:41.538147 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:37:41.538212 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:37:41.847108 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:37:43.305891 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:37:43.305974 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:37:43.306049 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:37:43.306113 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:37:43.306174 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:37:43.306230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:37:43.306287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:37:43.610772 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:38:10.103808 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:38:10.103903 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:38:10.103985 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:38:10.104068 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:38:10.104152 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:38:10.104223 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:38:10.104301 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:38:10.406261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:38:12.111631 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:38:12.111805 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:38:12.111930 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:38:12.112056 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:38:12.112187 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:38:12.112310 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:38:12.112432 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:38:12.426140 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:38:13.865712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:38:13.865825 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:38:13.865933 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:38:13.866010 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:38:13.866095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:38:13.866189 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:38:13.866268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:38:14.166537 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:38:42.682609 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:38:42.682781 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:38:42.682892 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:38:42.682993 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:38:42.683064 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:38:42.683132 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:38:42.683198 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:38:42.995306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:38:44.429829 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:38:44.429940 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:38:44.430018 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:38:44.430094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:38:44.430171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:38:44.430248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:38:44.430326 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:38:44.733697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:39:10.229265 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:39:10.229356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:39:10.229423 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:39:10.229486 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:39:10.229565 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:39:10.229631 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:39:10.229701 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:39:10.535927 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:39:13.257029 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:39:13.257119 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:39:13.257201 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:39:13.257267 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:39:13.257331 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:39:13.257388 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:39:13.257452 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:39:13.574873 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:39:15.009194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:39:15.009279 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:39:15.009344 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:39:15.009418 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:39:15.009478 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:39:15.009546 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:39:15.009611 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:39:15.321214 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:39:43.837343 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:39:43.837656 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:39:43.838364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:39:43.838460 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:39:43.838594 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:39:43.838673 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:39:43.838765 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:39:44.144611 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:39:45.584704 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:39:45.584819 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:39:45.584907 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:39:45.584991 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:39:45.585058 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:39:45.585123 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:39:45.585194 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:39:45.892886 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:40:10.356524 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:40:10.356623 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:40:10.356694 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:40:10.356765 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:40:10.356832 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:40:10.356897 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:40:10.356968 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:40:10.668831 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:40:14.410487 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:40:14.410604 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:40:14.410692 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:40:14.410773 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:40:14.410863 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:40:14.410952 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:40:14.411024 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:40:14.714600 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:40:16.156039 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:40:16.156142 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:40:16.156218 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:40:16.156306 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:40:16.156393 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:40:16.156465 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:40:16.156535 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:40:16.463941 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:40:44.970178 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:40:44.970279 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:40:44.970364 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:40:44.970440 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:40:44.970514 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:40:44.970592 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:40:44.970660 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:40:45.281959 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:40:46.732799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:40:46.732881 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:40:46.732952 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:40:46.733051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:40:46.733126 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:40:46.733214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:40:46.733279 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:40:47.043003 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:41:10.488710 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:41:10.488796 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:41:10.488859 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:41:10.488923 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:41:10.488999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:41:10.489063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:41:10.489127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:41:10.799324 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:41:15.548833 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:41:15.548955 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:41:15.549021 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:41:15.549088 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:41:15.549158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:41:15.549218 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:41:15.549280 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:41:15.862376 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:41:17.305397 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:41:17.305482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:41:17.305547 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:41:17.305613 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:41:17.305686 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:41:17.305764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:41:17.305836 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:41:17.609045 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:41:46.121139 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:41:46.121234 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:41:46.121305 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:41:46.121368 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:41:46.121436 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:41:46.121497 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:41:46.121565 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:41:46.428058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:41:47.876255 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:41:47.876368 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:41:47.876441 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:41:47.876503 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:41:47.876579 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:41:47.876644 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:41:47.876722 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:41:48.181438 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:42:10.620929 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:42:10.621022 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:42:10.621085 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:42:10.621155 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:42:10.621213 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:42:10.621276 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:42:10.621333 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:42:10.927841 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:42:16.687325 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:42:16.687409 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:42:16.687485 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:42:16.687552 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:42:16.687616 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:42:16.687676 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:42:16.687748 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:42:16.991351 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:42:18.449998 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:42:18.450114 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:42:18.450176 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:42:18.450234 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:42:18.450297 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:42:18.450358 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:42:18.450419 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:42:18.752680 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:42:47.254756 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:42:47.254838 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:42:47.254909 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:42:47.254975 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:42:47.255045 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:42:47.255107 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:42:47.255173 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:42:47.563763 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:42:49.013389 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:42:49.013474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:42:49.013535 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:42:49.013616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:42:49.013675 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:42:49.013750 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:42:49.013811 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:42:49.331835 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:43:10.749801 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:43:10.749884 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:43:10.749950 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:43:10.750020 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:43:10.750083 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:43:10.750150 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:43:10.750210 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:43:11.053250 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:43:17.831145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:43:17.831251 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:43:17.831327 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:43:17.831401 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:43:17.831474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:43:17.831543 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:43:17.831623 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:43:18.134274 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:43:19.594677 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:43:19.594781 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:43:19.594866 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:43:19.594945 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:43:19.595028 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:43:19.595104 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:43:19.595182 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:43:19.901639 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:43:48.397446 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:43:48.397556 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:43:48.397642 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:43:48.397711 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:43:48.397784 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:43:48.397863 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:43:48.397930 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:43:48.705422 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:43:50.178315 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:43:50.178426 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:43:50.178502 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:43:50.178574 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:43:50.178645 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:43:50.178732 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:43:50.178809 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:43:50.487081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:44:10.882516 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:44:10.882602 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:44:10.882691 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:44:10.882773 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:44:10.882834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:44:10.882903 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:44:10.882972 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:44:11.185172 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:44:18.971470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:44:18.971553 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:44:18.971629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:44:18.971698 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:44:18.971773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:44:18.971836 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:44:18.971902 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:44:19.278736 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:44:20.753595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:44:20.753689 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:44:20.753774 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:44:20.753839 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:44:20.753898 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:44:20.753971 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:44:20.754037 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:44:21.061670 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:44:49.539979 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:44:49.540081 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:44:49.540148 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:44:49.540213 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:44:49.540285 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:44:49.540346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:44:49.540412 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:44:49.849586 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:44:51.327692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:44:51.327792 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:44:51.327864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:44:51.327931 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:44:51.327996 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:44:51.328062 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:44:51.328123 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:44:51.630259 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:45:10.997308 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:45:10.997390 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:45:10.997474 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:45:10.997537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:45:10.997601 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:45:10.997663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:45:10.997725 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:45:11.303510 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:45:20.127229 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:45:20.127310 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:45:20.127380 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:45:20.127446 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:45:20.127509 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:45:20.127567 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:45:20.127628 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:45:20.431043 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:45:21.904251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:45:21.904336 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:45:21.904403 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:45:21.904466 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:45:21.904526 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:45:21.904591 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:45:21.904652 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:45:22.221864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:45:50.696147 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:45:50.696248 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:45:50.696323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:45:50.696391 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:45:50.696457 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:45:50.696522 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:45:50.696596 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:45:51.001455 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:45:52.487731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:45:52.487819 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:45:52.487889 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:45:52.487973 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:45:52.488043 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:45:52.488105 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:45:52.488166 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:45:52.797464 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:46:11.119550 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:46:11.119652 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:46:11.119727 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:46:11.119821 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:46:11.119892 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:46:11.119974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:46:11.120051 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:46:11.428079 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:46:21.269577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:46:21.269668 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:46:21.269758 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:46:21.269851 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:46:21.269925 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:46:21.270008 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:46:21.270085 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:46:21.580700 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:46:23.057370 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:46:23.057470 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:46:23.057531 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:46:23.057597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:46:23.057660 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:46:23.057728 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:46:23.057787 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:46:23.361006 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:46:51.842302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:46:51.842390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:46:51.842463 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:46:51.842532 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:46:51.842607 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:46:51.842670 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:46:51.842739 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:46:52.166317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:46:53.617622 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:46:53.617711 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:46:53.617801 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:46:53.617884 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:46:53.617946 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:46:53.618030 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:46:53.618090 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:46:53.918169 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:47:11.244387 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:47:11.244465 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:47:11.244537 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:47:11.244595 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:47:11.244657 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:47:11.244712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:47:11.244778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:47:11.550775 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:47:22.432558 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:47:22.432694 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:47:22.432764 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:47:22.432829 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:47:22.432890 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:47:22.432957 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:47:22.433020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:47:22.735963 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:47:24.180248 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:47:24.180334 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:47:24.180406 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:47:24.180468 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:47:24.180539 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:47:24.180616 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:47:24.180681 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:47:24.495089 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:47:53.002072 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:47:53.002185 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:47:53.002260 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:47:53.002321 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:47:53.002379 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:47:53.002446 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:47:53.002503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:47:53.315690 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:47:54.764547 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:47:54.764635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:47:54.764713 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:47:54.764784 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:47:54.764859 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:47:54.764937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:47:54.765005 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:47:55.082893 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:48:11.366869 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:48:11.366948 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:48:11.367014 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:48:11.367080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:48:11.367145 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:48:11.367206 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:48:11.367274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:48:11.678342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:48:23.578221 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:48:23.578324 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:48:23.578396 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:48:23.578470 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:48:23.578558 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:48:23.578627 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:48:23.578704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:48:23.883274 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:48:25.350578 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:48:25.350700 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:48:25.350795 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:48:25.350881 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:48:25.350950 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:48:25.352026 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:48:25.352450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:48:25.659155 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:48:54.143080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:48:54.143196 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:48:54.143275 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:48:54.143352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:48:54.143433 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:48:54.143509 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:48:54.143600 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:48:54.456164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:48:55.915210 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:48:55.915319 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:48:55.915409 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:48:55.915485 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:48:55.915568 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:48:55.915641 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:48:55.915729 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:48:56.226909 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:49:11.490602 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:49:11.490714 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:49:11.490798 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:49:11.490888 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:49:11.490969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:49:11.491041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:49:11.491114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:49:11.806312 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:49:24.716979 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:49:24.717081 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:49:24.717161 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:49:24.717245 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:49:24.717325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:49:24.717405 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:49:24.717479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:49:25.025637 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:49:26.494161 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:49:26.494259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:49:26.494351 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:49:26.494420 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:49:26.494492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:49:26.494574 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:49:26.494648 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:49:26.797094 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:49:55.291965 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:49:55.292047 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:49:55.292105 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:49:55.292180 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:49:55.292241 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:49:55.292304 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:49:55.292360 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:49:55.596185 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:49:57.064780 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:49:57.064873 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:49:57.064958 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:49:57.065026 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:49:57.065090 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:49:57.065153 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:49:57.065229 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:49:57.375107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:50:11.612180 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:50:11.612264 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:50:11.612335 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:50:11.612398 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:50:11.612460 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:50:11.612525 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:50:11.612588 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:50:11.928799 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:50:25.867201 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:50:25.867282 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:50:25.867350 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:50:25.867413 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:50:25.867481 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:50:25.867536 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:50:25.867607 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:50:26.178749 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:50:27.635663 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:50:27.635760 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:50:27.635829 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:50:27.635889 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:50:27.635949 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:50:27.636006 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:50:27.636064 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:50:27.945151 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:50:56.444994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:50:56.445137 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:50:56.445247 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:50:56.445338 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:50:56.445456 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:50:56.445565 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:50:56.445663 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:50:56.746309 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:50:58.209871 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:50:58.209984 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:50:58.210104 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:50:58.210197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:50:58.210286 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:50:58.210364 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:50:58.210463 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:50:58.517860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:51:11.742132 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:51:11.742221 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:51:11.742304 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:51:11.742371 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:51:11.742449 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:51:11.742518 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:51:11.742591 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:51:12.049990 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:51:27.004417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:51:27.004527 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:51:27.004616 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:51:27.004700 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:51:27.004802 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:51:27.004880 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:51:27.004962 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:51:27.305129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:51:28.778579 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:51:28.778673 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:51:28.778771 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:51:28.778854 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:51:28.778934 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:51:28.779013 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:51:28.779094 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:51:29.092060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:51:57.575449 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:51:57.575552 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:51:57.575636 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:51:57.575713 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:51:57.575812 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:51:57.575895 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:51:57.575975 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:51:57.873854 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:51:59.361179 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:51:59.361300 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:51:59.361399 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:51:59.361489 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:51:59.361586 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:51:59.361676 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:51:59.361778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:51:59.661583 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:52:11.864094 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:52:11.864189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:52:11.864273 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:52:11.864360 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:52:11.864432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:52:11.864508 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:52:11.864584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:52:12.191740 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:52:28.129033 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:52:28.129166 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:52:28.129255 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:52:28.129333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:52:28.129408 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:52:28.129490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:52:28.129569 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:52:28.431372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:52:29.918647 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:52:29.918775 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:52:29.918852 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:52:29.918938 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:52:29.919016 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:52:29.919092 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:52:29.919169 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:52:30.233767 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:52:58.688507 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:52:58.688614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:52:58.688694 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:52:58.688774 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:52:58.688853 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:52:58.688924 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:52:58.688993 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:52:59.001111 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:53:00.493824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:53:00.493915 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:53:00.493991 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:53:00.494054 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:53:00.494134 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:53:00.494196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:53:00.494259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:53:00.802131 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:53:11.991003 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:53:11.991089 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:53:11.991154 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:53:11.991214 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:53:11.991278 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:53:11.991346 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:53:11.991408 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:53:12.319832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:53:29.276734 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:53:29.276850 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:53:29.276933 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:53:29.277007 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:53:29.277084 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:53:29.277161 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:53:29.277235 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:53:29.576808 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:53:31.069337 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:53:31.069441 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:53:31.069521 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:53:31.069601 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:53:31.069675 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:53:31.069766 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:53:31.069840 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:53:31.369951 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:53:59.834157 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:53:59.834260 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:53:59.834332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:53:59.834406 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:53:59.834491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:53:59.834572 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:53:59.834649 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:54:00.146424 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:54:01.634305 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:54:01.634412 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:54:01.634493 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:54:01.634579 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:54:01.634659 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:54:01.634753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:54:01.634823 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:54:01.941593 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:54:12.105558 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:54:12.105652 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:54:12.105729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:54:12.105801 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:54:12.105871 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:54:12.105944 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:54:12.107084 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:54:12.422796 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:54:30.404958 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:54:30.405057 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:54:30.405136 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:54:30.405198 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:54:30.405260 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:54:30.405320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:54:30.405384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:54:30.705871 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:54:32.217287 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:54:32.217375 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:54:32.217442 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:54:32.217513 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:54:32.217579 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:54:32.217643 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:54:32.217704 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:54:32.526682 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:55:00.962459 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:55:00.962546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:55:00.962605 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:55:00.962672 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:55:00.962738 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:55:00.962802 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:55:00.962864 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:55:01.270011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:55:02.788341 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:55:02.788441 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:55:02.788507 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:55:02.788574 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:55:02.788637 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:55:02.788695 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:55:02.788769 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:55:03.105662 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:55:12.227736 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:55:12.227821 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:55:12.227890 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:55:12.227958 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:55:12.228019 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:55:12.228093 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:55:12.228155 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:55:12.532828 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:55:31.536419 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:55:31.536599 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:55:31.536738 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:55:31.536895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:55:31.537693 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:55:31.538702 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:55:31.538811 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:55:31.853835 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:55:33.366867 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:55:33.366971 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:55:33.367055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:55:33.367136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:55:33.367212 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:55:33.367289 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:55:33.367369 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:55:33.667605 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:56:02.132812 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:56:02.132904 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:56:02.132972 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:56:02.133038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:56:02.133110 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:56:02.133176 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:56:02.133245 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:56:02.445534 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:56:03.930731 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:56:03.930836 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:56:03.930895 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:56:03.930960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:56:03.931024 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:56:03.931086 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:56:03.931144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:56:04.236340 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:56:12.354368 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:56:12.354447 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:56:12.354527 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:56:12.354588 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:56:12.354653 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:56:12.354712 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:56:12.354778 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:56:12.652441 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:56:32.706175 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:56:32.706293 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:56:32.706360 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:56:32.706421 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:56:32.706486 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:56:32.706543 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:56:32.706611 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:56:33.015667 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:56:34.493156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:56:34.493239 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:56:34.493332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:56:34.493391 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:56:34.493458 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:56:34.493518 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:56:34.494536 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:56:34.793952 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:57:03.278046 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:57:03.278132 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:57:03.278202 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:57:03.278269 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:57:03.278330 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:57:03.278399 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:57:03.278462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:57:03.576462 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:57:05.054259 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:57:05.054345 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:57:05.054406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:57:05.054477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:57:05.054539 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:57:05.054605 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:57:05.054666 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:57:05.356905 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:57:12.479415 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:57:12.479498 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:57:12.479565 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:57:12.479637 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:57:12.479697 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:57:12.479770 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:57:12.479833 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:57:12.782265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:57:33.828685 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:57:33.828808 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:57:33.828872 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:57:33.828935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:57:33.829005 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:57:33.829065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:57:33.829130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:57:34.135533 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:57:35.616586 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:57:35.616677 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:57:35.616747 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:57:35.616820 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:57:35.616884 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:57:35.616942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:57:35.617005 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:57:35.920726 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:58:04.406562 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:58:04.406649 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:58:04.406729 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:58:04.406820 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:58:04.406884 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:58:04.406948 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:58:04.407021 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:58:04.711936 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:58:06.187454 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:58:06.187545 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:58:06.187612 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:58:06.187677 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:58:06.187747 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:58:06.187815 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:58:06.187880 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:58:06.496481 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:58:12.602619 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:58:12.602697 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:58:12.602772 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:58:12.602838 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:58:12.602903 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:58:12.602965 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:58:12.603032 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:58:12.917784 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:58:34.985965 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:58:34.986058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:58:34.986135 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:58:34.986205 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:58:34.986278 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:58:34.986333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:58:34.986393 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:58:35.290455 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:58:36.766347 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:58:36.766469 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:58:36.766532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:58:36.766590 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:58:36.766653 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:58:36.766725 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:58:36.766791 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:58:37.076908 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:59:05.550854 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:59:05.550939 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:59:05.551022 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:59:05.551089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:59:05.551156 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:59:05.551216 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:59:05.551281 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:59:05.857144 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:59:07.335193 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:59:07.335286 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:59:07.335355 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:59:07.335427 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:59:07.335490 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:59:07.335554 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:59:07.335616 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:59:07.654253 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:59:12.725220 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:59:12.725323 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:59:12.725392 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:59:12.725457 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:59:12.725522 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:59:12.725587 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:59:12.725649 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:59:13.032192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:59:36.113839 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:59:36.113921 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:59:36.113989 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:59:36.114054 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:59:36.114123 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:59:36.114184 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:59:36.114243 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:59:36.420214 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 19:59:37.926542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 19:59:37.926627 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 19:59:37.926705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 19:59:37.926771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 19:59:37.926841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 19:59:37.926905 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 19:59:37.926964 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 19:59:38.234044 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:00:06.689331 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:00:06.689419 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:00:06.689483 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:00:06.689550 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:00:06.689620 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:00:06.689680 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:00:06.689755 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:00:06.990758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:00:08.498277 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:00:08.498376 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:00:08.498455 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:00:08.498548 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:00:08.498626 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:00:08.498709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:00:08.498791 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:00:08.803767 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:00:12.850049 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:00:12.850171 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:00:12.850274 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:00:12.850388 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:00:12.850483 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:00:12.850593 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:00:12.850685 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:00:13.162599 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:00:37.259884 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:00:37.259986 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:00:37.260055 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:00:37.260119 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:00:37.260186 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:00:37.260243 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:00:37.260319 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:00:37.571313 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:00:39.062935 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:00:39.063027 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:00:39.063093 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:00:39.063158 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:00:39.063224 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:00:39.063292 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:00:39.063358 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:00:39.375344 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:01:07.830031 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:01:07.830128 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:01:07.830203 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:01:07.830267 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:01:07.830351 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:01:07.830414 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:01:07.830481 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:01:08.136430 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:01:09.639826 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:01:09.639919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:01:09.639984 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:01:09.640047 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:01:09.640123 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:01:09.640184 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:01:09.640254 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:01:09.947842 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:01:12.977306 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:01:12.977406 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:01:12.977487 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:01:12.977555 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:01:12.977627 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:01:12.977693 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:01:12.977767 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:01:13.285706 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:01:38.394451 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:01:38.394550 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:01:38.394623 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:01:38.394685 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:01:38.394758 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:01:38.394823 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:01:38.394887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:01:38.702351 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:01:40.215231 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:01:40.215312 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:01:40.215366 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:01:40.215444 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:01:40.215506 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:01:40.215566 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:01:40.215628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:01:40.524448 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:02:08.965556 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:02:08.965657 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:02:08.965727 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:02:08.965790 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:02:08.965860 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:02:08.965928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:02:08.965987 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:02:09.279301 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:02:10.783252 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:02:10.783338 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:02:10.783402 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:02:10.783497 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:02:10.783556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:02:10.783617 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:02:10.783680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:02:11.096117 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:02:13.102080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:02:13.102187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:02:13.102286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:02:13.102372 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:02:13.102455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:02:13.102538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:02:13.102625 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:02:13.403468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:02:39.546753 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:02:39.546860 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:02:39.546942 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:02:39.547025 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:02:39.547097 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:02:39.547170 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:02:39.547246 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:02:39.846314 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:02:41.357308 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:02:41.357411 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:02:41.357492 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:02:41.357575 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:02:41.357651 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:02:41.357740 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:02:41.357830 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:02:41.662143 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:03:10.118579 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:03:10.118710 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:03:10.118803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:03:10.118889 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:03:10.118973 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:03:10.119054 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:03:10.119132 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:03:10.430423 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:03:11.926112 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:03:11.926211 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:03:11.926284 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:03:11.926346 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:03:11.926412 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:03:11.926476 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:03:11.926540 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:03:12.234463 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:03:13.221357 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:03:13.221453 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:03:13.221534 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:03:13.221604 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:03:13.221677 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:03:13.221754 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:03:13.221839 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:03:13.527324 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:03:40.691852 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:03:40.691936 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:03:40.692015 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:03:40.692084 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:03:40.692152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:03:40.692215 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:03:40.692280 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:03:41.000781 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:03:42.493735 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:03:42.493821 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:03:42.493881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:03:42.493949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:03:42.494009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:03:42.494071 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:03:42.494131 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:03:42.806071 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:04:11.261336 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:04:11.261444 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:04:11.261522 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:04:11.261596 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:04:11.261680 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:04:11.261764 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:04:11.261854 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:04:11.561251 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:04:13.063498 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:04:13.063604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:04:13.063702 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:04:13.063809 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:04:13.063898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:04:13.063968 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:04:13.064053 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:04:13.367298 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:04:13.620413 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:04:13.620511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:04:13.620581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:04:13.620654 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:04:13.620731 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:04:13.620818 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:04:13.620883 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:04:13.935474 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:04:41.827728 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:04:41.828105 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:04:41.828458 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:04:41.828890 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:04:41.829620 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:04:41.829742 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:04:41.829851 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:04:42.153244 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:04:43.621940 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:04:43.622044 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:04:43.622109 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:04:43.622187 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:04:43.622249 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:04:43.622315 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:04:43.622378 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:04:43.939400 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:05:12.417860 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:05:12.417942 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:05:12.418020 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:05:12.418087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:05:12.418148 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:05:12.418225 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:05:12.418284 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:05:12.717545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:05:13.463573 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:05:13.463650 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:05:13.463729 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:05:13.463791 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:05:13.463850 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:05:13.463913 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:05:13.463973 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:05:13.774074 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:05:14.201683 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:05:14.201776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:05:14.201840 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:05:14.201908 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:05:14.201978 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:05:14.202037 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:05:14.202097 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:05:14.512260 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:05:42.980483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:05:42.980570 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:05:42.980641 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:05:42.980704 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:05:42.980770 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:05:42.980838 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:05:42.980901 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:05:43.283583 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:05:44.774935 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:05:44.775021 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:05:44.775115 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:05:44.775213 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:05:44.775282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:05:44.775367 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:05:44.775445 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:05:45.083891 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:06:13.538753 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:06:13.538835 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:06:13.538902 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:06:13.538966 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:06:13.539030 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:06:13.539093 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:06:13.539156 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:06:13.847725 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:06:14.106787 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:06:14.106868 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:06:14.106938 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:06:14.107004 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:06:14.107068 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:06:14.107136 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:06:14.107203 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:06:14.408619 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:06:15.342592 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:06:15.342670 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:06:15.342745 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:06:15.342809 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:06:15.342881 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:06:15.342938 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:06:15.342999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:06:15.651517 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:06:44.107970 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:06:44.108057 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:06:44.108133 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:06:44.108204 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:06:44.108265 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:06:44.108332 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:06:44.108392 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:06:44.431665 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:06:45.913943 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:06:45.914025 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:06:45.914098 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:06:45.914162 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:06:45.914222 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:06:45.914286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:06:45.914350 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:06:46.219920 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:07:13.712801 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:07:13.712876 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:07:13.712939 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:07:13.713006 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:07:13.713067 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:07:13.713126 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:07:13.713186 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:07:14.018621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:07:14.695102 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:07:14.695214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:07:14.695302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:07:14.695378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:07:14.695463 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:07:14.695549 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:07:14.695625 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:07:14.999711 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:07:16.481860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:07:16.481956 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:07:16.482035 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:07:16.482119 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:07:16.482195 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:07:16.482281 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:07:16.482353 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:07:16.783040 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:07:45.261271 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:07:45.261378 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:07:45.261449 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:07:45.261523 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:07:45.261591 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:07:45.261659 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:07:45.261733 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:07:45.573370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:07:47.056461 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:07:47.056567 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:07:47.056633 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:07:47.056699 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:07:47.056766 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:07:47.056831 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:07:47.056892 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:07:47.358905 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:08:13.832581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:08:13.832676 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:08:13.832756 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:08:13.832838 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:08:13.832913 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:08:13.832987 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:08:13.833081 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:08:14.140855 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:08:15.832609 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:08:15.832722 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:08:15.832814 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:08:15.832899 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:08:15.832975 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:08:15.833051 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:08:15.833133 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:08:16.138287 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:08:17.617041 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:08:17.617154 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:08:17.617242 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:08:17.617308 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:08:17.617380 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:08:17.617444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:08:17.617511 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:08:17.927227 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:08:46.404426 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:08:46.404535 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:08:46.404595 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:08:46.404661 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:08:46.404722 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:08:46.404791 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:08:46.404848 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:08:46.708046 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:08:48.189504 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:08:48.189596 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:08:48.189665 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:08:48.189737 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:08:48.189801 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:08:48.189862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:08:48.189922 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:08:48.495701 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:09:13.949996 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:09:13.950078 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:09:13.950149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:09:13.950221 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:09:13.950280 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:09:13.950344 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:09:13.950403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:09:14.267864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:09:16.967378 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:09:16.967472 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:09:16.967557 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:09:16.967637 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:09:16.967711 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:09:16.967860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:09:16.968001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:09:17.267274 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:09:18.765079 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:09:18.765174 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:09:18.765243 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:09:18.765314 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:09:18.765384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:09:18.765454 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:09:18.765526 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:09:19.076641 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:09:47.532142 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:09:47.532229 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:09:47.532302 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:09:47.532362 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:09:47.532432 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:09:47.532489 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:09:47.532555 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:09:47.851994 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:09:49.341618 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:09:49.341714 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:09:49.341823 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:09:49.341903 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:09:49.341977 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:09:49.342053 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:09:49.342129 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:09:49.645097 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:10:14.073004 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:10:14.073108 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:10:14.073180 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:10:14.073242 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:10:14.073319 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:10:14.073394 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:10:14.073467 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:10:14.382066 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:10:18.108629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:10:18.108727 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:10:18.109742 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:10:18.109946 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:10:18.110527 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:10:18.110863 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:10:18.111319 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:10:18.418982 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:10:19.906844 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:10:19.906924 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:10:19.906995 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:10:19.907062 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:10:19.907126 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:10:19.907189 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:10:19.907253 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:10:20.216565 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:10:48.684965 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:10:48.685058 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:10:48.685131 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:10:48.685195 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:10:48.685263 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:10:48.685328 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:10:48.685384 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:10:48.995851 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:10:50.481457 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:10:50.481568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:10:50.481633 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:10:50.481700 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:10:50.481768 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:10:50.481830 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:10:50.481886 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:10:50.784449 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:11:14.198858 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:11:14.198944 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:11:14.199013 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:11:14.199083 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:11:14.199151 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:11:14.199225 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:11:14.199290 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:11:14.525276 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:11:19.264308 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:11:19.264390 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:11:19.264463 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:11:19.264523 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:11:19.264581 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:11:19.264645 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:11:19.264706 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:11:19.574496 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:11:21.049621 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:11:21.049750 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:11:21.049845 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:11:21.049921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:11:21.049997 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:11:21.050067 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:11:21.051041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:11:21.356251 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:11:49.836752 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:11:49.836860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:11:49.836930 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:11:49.836996 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:11:49.837074 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:11:49.837154 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:11:49.837232 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:11:50.160316 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:11:51.618877 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:11:51.618971 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:11:51.619036 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:11:51.619112 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:11:51.619172 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:11:51.619238 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:11:51.619295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:11:51.926211 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:12:14.321171 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:12:14.321248 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:12:14.321314 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:12:14.321374 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:12:14.321443 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:12:14.321499 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:12:14.321562 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:12:14.628492 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:12:20.416528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:12:20.416605 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:12:20.416665 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:12:20.416748 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:12:20.416809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:12:20.416869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:12:20.416931 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:12:20.722584 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:12:22.198660 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:12:22.198751 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:12:22.198816 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:12:22.198898 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:12:22.198966 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:12:22.199032 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:12:22.199093 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:12:22.502874 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:12:50.991964 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:12:50.992086 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:12:50.992152 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:12:50.992216 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:12:50.992281 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:12:50.992341 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:12:50.992398 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:12:51.294964 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:12:52.764887 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:12:52.764994 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:12:52.765059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:12:52.765120 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:12:52.765179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:12:52.765237 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:12:52.765298 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:12:53.070786 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:13:14.441579 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:13:14.441663 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:13:14.441736 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:13:14.441792 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:13:14.441859 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:13:14.441918 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:13:14.441982 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:13:14.751963 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:13:21.558327 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:13:21.558452 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:13:21.558537 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:13:21.558597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:13:21.558666 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:13:21.558734 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:13:21.558800 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:13:21.865010 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:13:23.333566 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:13:23.333679 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:13:23.333773 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:13:23.333855 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:13:23.333941 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:13:23.334018 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:13:23.334091 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:13:23.641571 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:13:52.130402 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:13:52.130486 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:13:52.130553 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:13:52.131359 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:13:52.131739 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:13:52.132132 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:13:52.132777 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:13:52.444078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:13:53.905303 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:13:53.905383 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:13:53.905450 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:13:53.905515 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:13:53.905584 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:13:53.905645 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:13:53.905711 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:13:54.224380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:14:14.569442 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:14:14.569518 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:14:14.569601 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:14:14.569663 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:14:14.569729 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:14:14.569794 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:14:14.569850 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:14:14.880297 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:14:22.707512 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:14:22.707594 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:14:22.707672 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:14:22.707741 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:14:22.707798 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:14:22.707861 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:14:22.707919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:14:23.011296 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:14:24.486247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:14:24.486329 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:14:24.486394 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:14:24.486457 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:14:24.486520 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:14:24.486585 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:14:24.486647 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:14:24.792376 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:14:53.269038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:14:53.269124 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:14:53.269189 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:14:53.269256 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:14:53.269315 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:14:53.269381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:14:53.269442 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:14:53.575164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:14:55.061062 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:14:55.061210 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:14:55.061286 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:14:55.061356 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:14:55.061428 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:14:55.061516 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:14:55.061578 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:14:55.367240 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:15:14.701413 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:15:14.701488 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:15:14.701549 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:15:14.701610 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:15:14.701671 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:15:14.701734 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:15:14.701796 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:15:15.004799 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:15:23.836445 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:15:23.836529 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:15:23.836597 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:15:23.836661 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:15:23.836733 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:15:23.836792 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:15:23.836854 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:15:24.149530 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:15:25.625065 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:15:25.625147 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:15:25.625234 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:15:25.625290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:15:25.625353 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:15:25.625417 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:15:25.625479 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:15:25.929796 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:15:54.415315 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:15:54.415398 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:15:54.415476 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:15:54.415539 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:15:54.415602 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:15:54.415662 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:15:54.415727 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:15:54.722648 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:15:56.194084 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:15:56.194175 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:15:56.194247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:15:56.194314 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:15:56.194373 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:15:56.194440 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:15:56.194499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:15:56.502239 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:16:14.827794 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:16:14.828109 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:16:14.828419 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:16:14.829168 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:16:14.829833 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:16:14.829919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:16:14.829990 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:16:15.142227 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:16:24.989213 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:16:24.989295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:16:24.989365 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:16:24.989428 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:16:24.989501 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:16:24.989562 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:16:24.989628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:16:25.301089 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:16:26.759646 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:16:26.759739 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:16:26.759818 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:16:26.759885 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:16:26.759953 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:16:26.760016 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:16:26.760079 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:16:27.067098 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:16:55.560440 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:16:55.560541 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:16:55.560604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:16:55.560671 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:16:55.560741 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:16:55.560823 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:16:55.560897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:16:55.873965 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:16:57.326509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:16:57.326589 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:16:57.326667 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:16:57.326736 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:16:57.326797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:16:57.326858 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:16:57.326923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:16:57.631840 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:17:14.969965 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:17:14.970041 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:17:14.970105 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:17:14.970174 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:17:14.970234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:17:14.970296 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:17:14.970354 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:17:15.278246 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:17:26.133691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:17:26.133791 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:17:26.133857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:17:26.133923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:17:26.133983 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:17:26.134047 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:17:26.134104 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:17:26.441594 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:17:27.890085 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:17:27.890164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:17:27.890234 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:17:27.890294 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:17:27.890363 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:17:27.890428 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:17:27.890487 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:17:28.195349 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:17:56.703488 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:17:56.703602 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:17:56.703679 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:17:56.703746 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:17:56.703808 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:17:56.703867 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:17:56.703929 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:17:57.016928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:17:58.459510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:17:58.459594 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:17:58.459667 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:17:58.459745 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:17:58.459805 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:17:58.459865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:17:58.459924 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:17:58.767770 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:18:15.100775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:18:15.100858 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:18:15.100927 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:18:15.100993 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:18:15.101056 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:18:15.101118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:18:15.101176 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:18:15.403470 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:18:27.287704 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:18:27.287791 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:18:27.287858 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:18:27.287918 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:18:27.287984 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:18:27.288038 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:18:27.288094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:18:27.595856 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:18:29.033691 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:18:29.033789 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:18:29.033858 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:18:29.033920 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:18:29.033981 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:18:29.034039 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:18:29.034108 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:18:29.339448 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:18:57.857134 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:18:57.857221 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:18:57.857298 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:18:57.857362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:18:57.857426 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:18:57.857491 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:18:57.857553 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:18:58.159556 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:18:59.608271 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:18:59.608366 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:18:59.608444 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:18:59.608510 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:18:59.608565 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:18:59.608625 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:18:59.608684 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:18:59.930935 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:19:15.225155 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:19:15.225231 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:19:15.225297 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:19:15.225361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:19:15.225427 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:19:15.225486 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:19:15.225550 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:19:15.532254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:19:28.423781 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:19:28.423885 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:19:28.423943 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:19:28.424007 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:19:28.424064 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:19:28.424121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:19:28.424178 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:19:28.730058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:19:30.193045 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:19:30.193122 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:19:30.193187 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:19:30.193253 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:19:30.193318 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:19:30.193391 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:19:30.193454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:19:30.498484 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:19:58.993527 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:19:58.993616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:19:58.993679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:19:58.993753 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:19:58.993821 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:19:58.993885 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:19:58.993946 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:19:59.302787 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:20:00.761062 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:20:00.761145 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:20:00.761211 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:20:00.761282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:20:00.761343 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:20:00.761406 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:20:00.761469 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:20:01.072272 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:20:15.356165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:20:15.356263 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:20:15.356324 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:20:15.356388 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:20:15.356447 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:20:15.356510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:20:15.356566 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:20:15.662424 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:20:29.567954 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:20:29.568039 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:20:29.568101 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:20:29.568168 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:20:29.568225 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:20:29.568288 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:20:29.568363 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:20:29.871774 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:20:31.332406 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:20:31.332498 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:20:31.332567 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:20:31.332627 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:20:31.332705 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:20:31.332773 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:20:31.332839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:20:31.638367 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:21:00.132330 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:21:00.132426 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:21:00.132496 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:21:00.132563 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:21:00.132628 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:21:00.132690 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:21:00.132782 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:21:00.439981 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:21:01.902149 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:21:01.902243 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:21:01.902332 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:21:01.902425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:21:01.902523 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:21:01.902594 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:21:01.902676 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:21:02.206624 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:21:15.492596 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:21:15.492709 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:21:15.492790 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:21:15.492866 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:21:15.492933 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:21:15.493003 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:21:15.493083 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:21:15.802047 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:21:30.702415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:21:30.702540 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:21:30.702636 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:21:30.702721 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:21:30.702799 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:21:30.702877 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:21:30.702946 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:21:31.001684 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:21:32.470193 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:21:32.470288 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:21:32.470362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:21:32.470435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:21:32.470509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:21:32.470579 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:21:32.470652 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:21:32.782068 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:22:01.259464 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:22:01.259569 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:22:01.259636 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:22:01.259703 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:22:01.259770 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:22:01.259837 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:22:01.259921 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:22:01.567820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:22:03.049376 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:22:03.049477 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:22:03.049559 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:22:03.049643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:22:03.049729 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:22:03.049806 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:22:03.049879 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:22:03.353791 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:22:15.618378 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:22:15.618478 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:22:15.618554 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:22:15.618637 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:22:15.618714 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:22:15.618796 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:22:15.618871 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:22:15.925835 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:22:31.836357 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:22:31.836466 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:22:31.836538 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:22:31.836610 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:22:31.836672 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:22:31.836755 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:22:31.836827 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:22:32.156236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:22:33.617946 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:22:33.618029 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:22:33.618099 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:22:33.618164 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:22:33.618230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:22:33.618289 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:22:33.618352 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:22:33.937859 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:23:02.417646 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:23:02.417771 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:23:02.417841 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:23:02.417907 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:23:02.417971 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:23:02.418035 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:23:02.418100 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:23:02.726037 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:23:04.226902 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:23:04.226996 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:23:04.227065 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:23:04.227126 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:23:04.227192 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:23:04.227249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:23:04.227310 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:23:04.533771 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:23:15.743145 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:23:15.743222 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:23:15.743297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:23:15.743361 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:23:15.743428 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:23:15.743493 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:23:15.743551 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:23:16.047384 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:23:32.986263 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:23:32.986354 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:23:32.986426 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:23:32.986490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:23:32.986554 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:23:32.986626 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:23:32.986685 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:23:33.299443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:23:34.795327 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:23:34.795405 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:23:34.795471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:23:34.795531 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:23:34.795598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:23:34.795656 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:23:34.795722 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:23:35.101053 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:24:03.558235 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:24:03.558336 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:24:03.558399 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:24:03.558466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:24:03.558530 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:24:03.558597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:24:03.558656 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:24:03.865758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:24:05.364845 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:24:05.364938 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:24:05.365014 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:24:05.365089 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:24:05.365157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:24:05.365224 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:24:05.365298 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:24:05.667145 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:24:15.873386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:24:15.873461 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:24:15.873534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:24:15.873596 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:24:15.873659 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:24:15.873723 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:24:15.873789 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:24:16.176464 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:24:34.136912 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:24:34.137042 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:24:34.137119 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:24:34.137203 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:24:34.137278 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:24:34.137354 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:24:34.137423 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:24:34.444166 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:24:35.920774 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:24:35.920892 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:24:35.920962 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:24:35.921041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:24:35.921112 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:24:35.921181 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:24:35.921254 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:24:36.226596 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:25:04.710129 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:25:04.710239 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:25:04.710313 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:25:04.710388 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:25:04.710472 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:25:04.710546 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:25:04.710621 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:25:05.020750 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:25:06.488573 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:25:06.490002 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:25:06.490484 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:25:06.491226 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:25:06.492097 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:25:06.492215 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:25:06.492301 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:25:06.796971 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:25:16.000789 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:25:16.000887 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:25:16.000992 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:25:16.001069 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:25:16.001154 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:25:16.001229 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:25:16.001312 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:25:16.301729 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:25:35.281637 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:25:35.281742 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:25:35.281838 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:25:35.281918 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:25:35.282001 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:25:35.282091 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:25:35.282186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:25:35.585932 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:25:37.062939 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:25:37.063053 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:25:37.063130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:25:37.063236 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:25:37.063310 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:25:37.063387 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:25:37.063462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:25:37.364573 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:26:05.842655 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:26:05.842764 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:26:05.842870 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:26:05.842958 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:26:05.843037 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:26:05.843124 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:26:05.843207 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:26:06.149781 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:26:07.628196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:26:07.628290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:26:07.628378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:26:07.628460 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:26:07.628535 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:26:07.628611 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:26:07.628683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:26:07.926335 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:26:16.127154 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:26:16.127795 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:26:16.128377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:26:16.129274 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:26:16.129377 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:26:16.129455 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:26:16.129534 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:26:16.435788 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:26:36.415424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:26:36.415531 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:26:36.415612 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:26:36.415689 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:26:36.415788 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:26:36.415868 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:26:36.415933 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:26:36.720486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:26:38.199906 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:26:38.200002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:26:38.200076 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:26:38.200158 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:26:38.200232 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:26:38.200303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:26:38.200374 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:26:38.512261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:27:06.988951 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:27:06.989069 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:27:06.989146 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:27:06.989240 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:27:06.989314 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:27:06.989385 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:27:06.989456 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:27:07.293543 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:27:08.780668 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:27:08.780786 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:27:08.780856 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:27:08.780935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:27:08.781006 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:27:08.781096 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:27:08.781177 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:27:09.087876 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:27:16.252922 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:27:16.253008 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:27:16.253076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:27:16.253162 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:27:16.253242 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:27:16.253315 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:27:16.253383 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:27:16.564252 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:27:37.557450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:27:37.557548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:27:37.557615 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:27:37.557684 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:27:37.557753 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:27:37.557820 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:27:37.557885 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:27:37.868312 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:27:39.357645 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:27:39.357726 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:27:39.357810 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:27:39.357874 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:27:39.357942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:27:39.358002 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:27:39.358064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:27:39.664628 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:28:08.125317 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:28:08.125408 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:28:08.125472 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:28:08.125556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:28:08.125626 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:28:08.125682 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:28:08.125747 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:28:08.429930 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:28:09.932163 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:28:09.932275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:28:09.932335 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:28:09.932407 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:28:09.932465 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:28:09.932526 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:28:09.932586 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:28:10.237148 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:28:16.382880 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:28:16.382961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:28:16.383031 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:28:16.383096 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:28:16.383157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:28:16.383227 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:28:16.383290 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:28:16.688248 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:28:38.694658 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:28:38.694741 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:28:38.694805 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:28:38.694864 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:28:38.694924 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:28:38.694979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:28:38.695035 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:28:39.004486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:28:40.506120 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:28:40.506204 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:28:40.506274 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:28:40.506335 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:28:40.506398 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:28:40.506461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:28:40.506521 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:28:40.808947 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:29:09.273084 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:29:09.273168 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:29:09.273233 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:29:09.273307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:29:09.273367 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:29:09.273434 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:29:09.273494 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:29:09.580190 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:29:11.071025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:29:11.071144 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:29:11.071204 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:29:11.071267 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:29:11.071327 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:29:11.071386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:29:11.071444 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:29:11.378409 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:29:16.508471 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:29:16.508547 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:29:16.508611 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:29:16.508679 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:29:16.508746 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:29:16.508810 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:29:16.508873 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:29:16.816923 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:29:39.840615 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:29:39.840725 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:29:39.840783 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:29:39.840861 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:29:39.840932 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:29:39.840989 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:29:39.841053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:29:40.168147 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:29:41.639745 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:29:41.639840 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:29:41.639903 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:29:41.639972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:29:41.640031 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:29:41.640096 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:29:41.640157 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:29:41.945842 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:30:10.432654 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:30:10.432760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:30:10.432827 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:30:10.432886 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:30:10.432948 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:30:10.433004 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:30:10.433064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:30:10.736439 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:30:12.215976 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:30:12.216056 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:30:12.216123 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:30:12.216182 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:30:12.216250 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:30:12.216305 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:30:12.216365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:30:12.513587 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:30:16.634547 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:30:16.634629 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:30:16.634687 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:30:16.634768 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:30:16.634834 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:30:16.634897 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:30:16.634960 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:30:16.944265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:30:41.001447 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:30:41.001528 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:30:41.001593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:30:41.001657 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:30:41.001721 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:30:41.001780 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:30:41.001843 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:30:41.303594 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:30:42.768616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:30:42.769446 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:30:42.769537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:30:42.769610 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:30:42.769688 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:30:42.769766 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:30:42.769858 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:30:43.085559 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:31:11.569943 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:31:11.570031 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:31:11.570094 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:31:11.570161 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:31:11.570225 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:31:11.570290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:31:11.570353 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:31:11.878228 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:31:13.347453 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:31:13.347537 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:31:13.347604 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:31:13.347664 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:31:13.347733 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:31:13.347799 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:31:13.347866 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:31:13.657510 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:31:16.760104 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:31:16.760183 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:31:16.760254 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:31:16.760322 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:31:16.760384 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:31:16.760448 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:31:16.760513 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:31:17.073472 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:31:42.148659 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:31:42.148743 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:31:42.148828 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:31:42.148902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:31:42.148958 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:31:42.149016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:31:42.149079 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:31:42.451894 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:31:43.932606 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:31:43.932682 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:31:43.932759 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:31:43.932837 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:31:43.932896 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:31:43.932949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:31:43.933016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:31:44.240894 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:32:12.710972 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:32:12.711053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:32:12.711122 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:32:12.711186 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:32:12.711242 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:32:12.711310 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:32:12.711373 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:32:13.030414 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:32:14.504230 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:32:14.504338 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:32:14.504405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:32:14.504472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:32:14.504533 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:32:14.504600 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:32:14.504662 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:32:14.810742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:32:16.889824 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:32:16.889906 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:32:16.889973 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:32:16.890033 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:32:16.890098 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:32:16.890161 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:32:16.890222 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:32:17.200927 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:32:43.292160 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:32:43.292284 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:32:43.292366 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:32:43.292450 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:32:43.292529 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:32:43.292604 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:32:43.292690 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:32:43.593254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:32:45.069147 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:32:45.069263 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:32:45.069345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:32:45.069421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:32:45.069505 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:32:45.069578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:32:45.069663 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:32:45.371913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:33:13.870520 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:33:13.870661 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:33:13.870805 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:33:13.870921 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:33:13.871029 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:33:13.871142 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:33:13.871275 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:33:14.184515 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:33:15.627274 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:33:15.627370 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:33:15.627441 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:33:15.627510 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:33:15.627576 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:33:15.627646 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:33:15.627710 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:33:15.940947 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:33:17.018575 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:33:17.018657 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:33:17.018741 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:33:17.018816 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:33:17.018884 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:33:17.018964 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:33:17.019042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:33:17.325751 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:33:44.446434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:33:44.446535 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:33:44.446615 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:33:44.446690 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:33:44.446774 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:33:44.446845 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:33:44.446925 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:33:44.755138 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:33:46.202228 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:33:46.202324 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:33:46.202408 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:33:46.202488 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:33:46.202574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:33:46.202657 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:33:46.202746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:33:46.508570 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:34:15.016104 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:34:15.016217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:34:15.016289 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:34:15.016358 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:34:15.016439 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:34:15.016507 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:34:15.016581 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:34:15.322644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:34:16.773647 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:34:16.774749 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:34:16.774844 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:34:16.774917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:34:16.774996 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:34:16.775075 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:34:16.775171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:34:17.090890 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:34:17.351702 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:34:17.351817 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:34:17.351895 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:34:17.351970 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:34:17.352042 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:34:17.352120 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:34:17.352192 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:34:17.650967 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:34:45.581863 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:34:45.581976 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:34:45.582060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:34:45.582130 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:34:45.582199 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:34:45.582269 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:34:45.582335 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:34:45.891503 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:34:47.353256 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:34:47.353377 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:34:47.353450 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:34:47.353525 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:34:47.353598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:34:47.353666 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:34:47.353737 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:34:47.654844 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:35:16.155294 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:35:16.155399 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:35:16.155484 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:35:16.155553 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:35:16.155624 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:35:16.155695 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:35:16.155771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:35:16.468987 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:35:17.274165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:35:17.274271 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:35:17.274358 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:35:17.274430 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:35:17.274502 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:35:17.274583 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:35:17.274656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:35:17.578527 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:35:17.920754 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:35:17.920845 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:35:17.920934 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:35:17.920994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:35:17.921955 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:35:17.922241 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:35:17.923037 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:35:18.228380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:35:46.730837 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:35:46.730940 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:35:46.731005 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:35:46.731072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:35:46.731131 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:35:46.731196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:35:46.731258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:35:47.038355 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:35:48.490749 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:35:48.490826 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:35:48.490895 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:35:48.490959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:35:48.491024 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:35:48.491096 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:35:48.491166 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:35:48.797538 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:36:17.301187 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:36:17.301266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:36:17.301336 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:36:17.301399 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:36:17.301458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:36:17.301525 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:36:17.301583 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:36:17.610945 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:36:17.872557 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:36:17.872645 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:36:17.872722 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:36:17.872796 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:36:17.872859 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:36:17.872928 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:36:17.872997 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:36:18.171052 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:36:19.068356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:36:19.068449 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:36:19.068511 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:36:19.068584 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:36:19.068647 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:36:19.068714 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:36:19.068775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:36:19.376094 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:36:47.873531 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:36:47.873615 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:36:47.873679 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:36:47.873747 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:36:47.873810 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:36:47.873868 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:36:47.873932 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:36:48.175136 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:36:49.643889 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:36:49.643964 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:36:49.644028 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:36:49.644100 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:36:49.644163 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:36:49.644227 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:36:49.644293 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:36:49.965026 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:37:17.531122 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:37:17.531204 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:37:17.531266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:37:17.531337 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:37:17.531398 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:37:17.531460 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:37:17.531518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:37:17.850917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:37:18.433916 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:37:18.434009 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:37:18.434077 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:37:18.434150 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:37:18.434217 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:37:18.434284 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:37:18.434352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:37:18.734983 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:37:20.246281 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:37:20.246368 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:37:20.246432 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:37:20.246507 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:37:20.246571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:37:20.246638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:37:20.246697 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:37:20.552758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:37:49.007177 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:37:49.007283 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:37:49.007373 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:37:49.007439 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:37:49.007511 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:37:49.007571 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:37:49.007628 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:37:49.313060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:37:50.811535 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:37:50.811628 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:37:50.811695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:37:50.811764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:37:50.811831 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:37:50.811894 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:37:50.811954 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:37:51.120425 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:38:17.655498 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:38:17.655583 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:38:17.655649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:38:17.655710 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:38:17.655780 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:38:17.655844 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:38:17.655905 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:38:17.968138 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:38:19.571439 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:38:19.571522 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:38:19.571600 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:38:19.571663 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:38:19.571728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:38:19.571806 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:38:19.571882 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:38:19.884664 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:38:21.380560 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:38:21.380649 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:38:21.380731 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:38:21.380792 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:38:21.380856 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:38:21.380927 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:38:21.380984 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:38:21.685193 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:38:50.159498 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:38:50.159845 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:38:50.159996 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:38:50.160320 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:38:50.160601 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:38:50.161170 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:38:50.161771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:38:50.464007 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:38:51.945999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:38:51.946084 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:38:51.946151 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:38:51.946221 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:38:51.946292 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:38:51.946365 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:38:51.946430 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:38:52.253571 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:39:17.787981 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:39:17.788055 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:39:17.788119 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:39:17.788182 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:39:17.788246 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:39:17.788308 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:39:17.788373 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:39:18.092601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:39:20.727358 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:39:20.727450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:39:20.727521 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:39:20.727581 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:39:20.727642 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:39:20.727701 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:39:20.727767 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:39:21.029210 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:39:22.511746 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:39:22.511868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:39:22.511927 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:39:22.511994 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:39:22.512055 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:39:22.512118 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:39:22.512176 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:39:22.816401 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:39:51.292404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:39:51.292495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:39:51.292565 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:39:51.292625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:39:51.292692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:39:51.292760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:39:51.292822 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:39:51.596429 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:39:53.080563 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:39:53.080651 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:39:53.080713 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:39:53.080789 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:39:53.080848 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:39:53.080917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:39:53.080988 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:39:53.389662 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:40:17.919898 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:40:17.919971 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:40:17.920033 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:40:17.920117 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:40:17.920177 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:40:17.920235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:40:17.920295 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:40:18.230997 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:40:21.860168 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:40:21.860250 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:40:21.860334 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:40:21.860390 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:40:21.860458 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:40:21.860516 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:40:21.860579 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:40:22.167821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:40:23.648282 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:40:23.648370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:40:23.648446 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:40:23.648509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:40:23.648567 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:40:23.648628 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:40:23.648686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:40:23.959381 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:40:52.427177 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:40:52.427266 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:40:52.427326 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:40:52.427388 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:40:52.427451 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:40:52.427514 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:40:52.427578 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:40:52.731069 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:40:54.232547 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:40:54.232640 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:40:54.232711 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:40:54.232790 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:40:54.232857 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:40:54.232916 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:40:54.232979 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:40:54.534913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:41:18.043641 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:41:18.043733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:41:18.043805 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:41:18.043867 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:41:18.043933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:41:18.043997 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:41:18.044059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:41:18.354794 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:41:22.994250 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:41:22.994333 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:41:22.994404 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:41:22.994470 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:41:22.994533 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:41:22.994592 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:41:22.994658 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:41:23.298532 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:41:24.796731 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:41:24.796828 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:41:24.796894 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:41:24.796957 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:41:24.797024 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:41:24.797084 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:41:24.797144 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:41:25.113056 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:41:53.565060 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:41:53.565167 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:41:53.565226 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:41:53.565298 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:41:53.565360 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:41:53.565420 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:41:53.565477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:41:53.874540 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:41:55.376833 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:41:55.376918 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:41:55.376994 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:41:55.377055 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:41:55.377118 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:41:55.377182 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:41:55.377238 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:41:55.686934 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:42:18.175594 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:42:18.175677 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:42:18.175767 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:42:18.175834 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:42:18.175891 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:42:18.175955 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:42:18.176016 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:42:18.486301 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:42:24.142691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:42:24.142972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:42:24.143687 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:42:24.144249 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:42:24.144338 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:42:24.144429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:42:24.144508 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:42:24.447024 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:42:25.952572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:42:25.952673 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:42:25.952761 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:42:25.952840 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:42:25.952901 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:42:25.952964 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:42:25.953028 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:42:26.262651 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:42:54.707170 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:42:54.707251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:42:54.707325 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:42:54.707393 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:42:54.707453 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:42:54.707519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:42:54.707578 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:42:55.015209 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:42:56.520702 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:42:56.520800 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:42:56.520873 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:42:56.520934 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:42:56.521001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:42:56.521062 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:42:56.521123 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:42:56.819522 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:43:18.303631 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:43:18.303710 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:43:18.303781 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:43:18.303846 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:43:18.303913 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:43:18.303976 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:43:18.304041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:43:18.614351 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:43:25.280226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:43:25.280309 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:43:25.280383 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:43:25.280445 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:43:25.280513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:43:25.280573 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:43:25.280644 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:43:25.587175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:43:27.084603 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:43:27.084806 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:43:27.085127 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:43:27.085862 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:43:27.086541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:43:27.086638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:43:27.086716 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:43:27.386258 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:43:55.848835 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:43:55.848934 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:43:55.848996 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:43:55.849068 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:43:55.849134 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:43:55.849211 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:43:55.849275 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:43:56.160738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:43:57.647922 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:43:57.648021 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:43:57.648085 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:43:57.648150 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:43:57.648220 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:43:57.648286 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:43:57.648352 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:43:57.951287 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:44:18.438497 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:44:18.438579 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:44:18.438647 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:44:18.438714 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:44:18.438780 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:44:18.438846 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:44:18.438907 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:44:18.748175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:44:26.422094 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:44:26.422218 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:44:26.422305 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:44:26.422372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:44:26.422445 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:44:26.422513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:44:26.422580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:44:26.725163 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:44:28.209789 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:44:28.209891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:44:28.209961 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:44:28.210023 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:44:28.210089 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:44:28.210150 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:44:28.210213 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:44:28.516328 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:44:56.987984 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:44:56.988078 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:44:56.988145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:44:56.988209 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:44:56.988271 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:44:56.988331 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:44:56.988393 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:44:57.291372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:44:58.780437 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:44:58.780518 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:44:58.780584 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:44:58.780647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:44:58.780716 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:44:58.780789 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:44:58.780857 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:44:59.099284 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:45:18.564326 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:45:18.564403 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:45:18.564463 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:45:18.564529 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:45:18.564589 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:45:18.564651 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:45:18.564708 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:45:18.869109 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:45:27.551361 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:45:27.551484 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:45:27.551561 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:45:27.551628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:45:27.551687 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:45:27.551759 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:45:27.551817 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:45:27.859733 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:45:29.369312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:45:29.369397 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:45:29.369462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:45:29.369527 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:45:29.369594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:45:29.369659 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:45:29.369728 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:45:29.674742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:45:58.120380 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:45:58.120509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:45:58.120579 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:45:58.120658 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:45:58.120736 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:45:58.120813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:45:58.120888 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:45:58.426626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:45:59.936284 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:45:59.936388 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:45:59.936462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:45:59.936544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:45:59.936608 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:45:59.936674 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:45:59.936737 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:46:00.246431 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:46:18.683574 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:46:18.683658 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:46:18.683734 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:46:18.683802 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:46:18.683864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:46:18.683925 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:46:18.683990 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:46:19.000023 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:46:28.689709 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:46:28.689810 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:46:28.689871 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:46:28.689948 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:46:28.690013 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:46:28.690080 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:46:28.690145 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:46:29.007016 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:46:30.506388 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:46:30.506472 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:46:30.506542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:46:30.506615 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:46:30.506682 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:46:30.506757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:46:30.506823 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:46:30.809931 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:46:59.276035 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:46:59.276121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:46:59.276188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:46:59.276251 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:46:59.276315 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:46:59.276375 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:46:59.276436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:46:59.577634 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:47:01.072655 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:47:01.073127 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:47:01.073214 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:47:01.073286 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:47:01.073357 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:47:01.073431 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:47:01.073495 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:47:01.375527 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:47:18.808922 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:47:18.809002 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:47:18.809064 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:47:18.809129 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:47:18.809200 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:47:18.809265 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:47:18.809329 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:47:19.120658 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:47:29.839378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:47:29.839456 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:47:29.839538 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:47:29.839597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:47:29.839660 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:47:29.839730 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:47:29.839793 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:47:30.155811 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:47:31.634376 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:47:31.634459 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:47:31.634532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:47:31.634609 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:47:31.634670 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:47:31.634740 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:47:31.634816 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:47:31.952602 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:48:00.419298 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:48:00.419388 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:48:00.419451 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:48:00.419517 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:48:00.419578 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:48:00.419645 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:48:00.419708 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:48:00.724644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:48:02.224212 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:48:02.224302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:48:02.224368 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:48:02.224436 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:48:02.224506 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:48:02.224575 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:48:02.224636 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:48:02.523071 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:48:18.932550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:48:18.932652 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:48:18.932742 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:48:18.932805 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:48:18.932869 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:48:18.932929 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:48:18.932988 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:48:19.247197 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:48:30.981853 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:48:30.981935 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:48:30.981995 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:48:30.982060 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:48:30.982120 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:48:30.982179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:48:30.982245 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:48:31.291443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:48:32.775979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:48:32.776062 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:48:32.776139 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:48:32.776199 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:48:32.776266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:48:32.776328 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:48:32.776391 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:48:33.082142 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:49:01.551379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:49:01.551476 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:49:01.551539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:49:01.551600 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:49:01.551657 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:49:01.551725 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:49:01.551787 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:49:01.856290 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:49:03.341726 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:49:03.341813 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:49:03.341883 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:49:03.341948 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:49:03.342013 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:49:03.342070 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:49:03.342137 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:49:03.662039 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:49:19.056057 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:49:19.056136 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:49:19.056207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:49:19.056275 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:49:19.056340 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:49:19.056406 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:49:19.056462 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:49:19.370809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:49:32.123555 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:49:32.123636 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:49:32.123704 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:49:32.123779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:49:32.123847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:49:32.123910 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:49:32.123977 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:49:32.428791 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:49:33.926054 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:49:33.926144 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:49:33.926223 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:49:33.926286 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:49:33.926354 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:49:33.926418 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:49:33.926486 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:49:34.237636 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:50:02.688294 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:50:02.688385 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:50:02.688451 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:50:02.688517 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:50:02.688578 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:50:02.688643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:50:02.688712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:50:02.996481 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:50:04.503407 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:50:04.503493 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:50:04.503559 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:50:04.503623 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:50:04.503684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:50:04.503759 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:50:04.503824 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:50:04.814062 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:50:19.178940 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:50:19.179020 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:50:19.179091 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:50:19.179164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:50:19.179231 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:50:19.179291 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:50:19.179355 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:50:19.487787 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:50:33.264204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:50:33.264291 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:50:33.264368 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:50:33.264432 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:50:33.264488 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:50:33.264549 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:50:33.264612 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:50:33.572865 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:50:35.091537 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:50:35.091656 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:50:35.091749 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:50:35.091825 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:50:35.091897 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:50:35.091979 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:50:35.092055 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:50:35.398690 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:51:03.829241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:51:03.829350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:51:03.829421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:51:03.829492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:51:03.829560 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:51:03.829633 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:51:03.829702 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:51:04.135327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:51:05.661846 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:51:05.661951 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:51:05.662035 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:51:05.662121 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:51:05.662200 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:51:05.662280 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:51:05.662349 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:51:05.962469 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:51:19.308009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:51:19.308099 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:51:19.308179 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:51:19.308249 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:51:19.308323 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:51:19.308395 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:51:19.308474 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:51:19.617753 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:51:34.398947 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:51:34.399046 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:51:34.399110 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:51:34.399169 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:51:34.399227 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:51:34.399288 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:51:34.399349 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:51:34.711257 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:51:36.222849 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:51:36.222944 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:51:36.223003 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:51:36.223067 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:51:36.223134 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:51:36.223193 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:51:36.223253 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:51:36.522974 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:52:04.977844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:52:04.977925 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:52:04.978004 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:52:04.978066 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:52:04.978132 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:52:04.978195 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:52:04.978262 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:52:05.288242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:52:06.788657 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:52:06.788757 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:52:06.788825 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:52:06.788885 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:52:06.788949 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:52:06.789009 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:52:06.789078 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:52:07.087828 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:52:19.427620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:52:19.427696 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:52:19.427772 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:52:19.427836 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:52:19.427902 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:52:19.427962 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:52:19.428026 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:52:19.736838 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:52:35.545100 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:52:35.545221 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:52:35.545285 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:52:35.545353 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:52:35.545422 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:52:35.545489 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:52:35.545555 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:52:35.853594 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:52:37.347072 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:52:37.347160 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:52:37.347226 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:52:37.347301 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:52:37.347358 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:52:37.347421 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:52:37.347482 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:52:37.654767 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:53:06.116221 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:53:06.116306 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:53:06.116372 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:53:06.116445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:53:06.116506 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:53:06.116569 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:53:06.116631 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:53:06.424466 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:53:07.915868 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:53:07.915962 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:53:07.916030 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:53:07.916112 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:53:07.916186 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:53:07.916258 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:53:07.916326 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:53:08.223435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:53:19.550604 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:53:19.550690 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:53:19.550767 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:53:19.550840 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:53:19.550906 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:53:19.550971 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:53:19.551032 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:53:19.868840 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:53:36.683943 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:53:36.684030 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:53:36.684099 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:53:36.684165 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:53:36.684234 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:53:36.684304 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:53:36.684362 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:53:36.992683 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:53:38.483260 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:53:38.483346 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:53:38.483427 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:53:38.483484 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:53:38.483551 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:53:38.483618 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:53:38.483677 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:53:38.786899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:54:07.254136 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:54:07.254227 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:54:07.254302 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:54:07.254370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:54:07.254455 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:54:07.254525 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:54:07.254597 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:54:07.566463 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:54:09.051204 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:54:09.051296 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:54:09.051357 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:54:09.051425 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:54:09.051491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:54:09.051553 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:54:09.051620 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:54:09.360950 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:54:19.671085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:54:19.671163 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:54:19.671241 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:54:19.671302 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:54:19.671368 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:54:19.671430 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:54:19.671492 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:54:19.993940 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:54:37.827343 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:54:37.827426 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:54:37.827496 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:54:37.827561 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:54:37.827626 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:54:37.827687 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:54:37.827753 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:54:38.143467 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:54:39.623841 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:54:39.623929 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:54:39.624011 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:54:39.624080 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:54:39.624140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:54:39.624215 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:54:39.624283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:54:39.937140 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:55:08.408515 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:55:08.408599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:55:08.408660 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:55:08.408735 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:55:08.408802 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:55:08.408863 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:55:08.408928 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:55:08.714394 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:55:10.203083 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:55:10.203164 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:55:10.203239 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:55:10.203312 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:55:10.203376 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:55:10.203436 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:55:10.203497 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:55:10.505690 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:55:19.794450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:55:19.794530 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:55:19.794603 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:55:19.794663 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:55:19.794744 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:55:19.794805 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:55:19.794872 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:55:20.103071 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:55:38.979037 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:55:38.979136 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:55:38.979213 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:55:38.979284 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:55:38.979357 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:55:38.979428 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:55:38.979497 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:55:39.294076 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:55:40.768499 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:55:40.768611 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:55:40.768698 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:55:40.768788 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:55:40.768871 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:55:40.768956 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:55:40.769037 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:55:41.082955 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:56:09.557273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:56:09.557381 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:56:09.557468 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:56:09.557534 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:56:09.557603 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:56:09.557672 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:56:09.557751 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:56:09.864170 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:56:11.344952 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:56:11.345052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:56:11.345121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:56:11.345186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:56:11.345244 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:56:11.345318 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:56:11.345371 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:56:11.652633 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:56:19.917279 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:56:19.917370 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:56:19.917450 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:56:19.917524 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:56:19.917594 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:56:19.917665 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:56:19.917743 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:56:20.229963 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:56:40.128812 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:56:40.128894 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:56:40.128962 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:56:40.129023 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:56:40.129089 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:56:40.129150 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:56:40.129213 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:56:40.438541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:56:41.916448 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:56:41.916545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:56:41.916611 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:56:41.916673 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:56:41.916745 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:56:41.916805 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:56:41.916868 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:56:42.236361 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:57:10.699085 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:57:10.699197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:57:10.699267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:57:10.699330 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:57:10.699401 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:57:10.699464 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:57:10.699527 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:57:11.007900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:57:12.499104 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:57:12.499486 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:57:12.499826 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:57:12.499926 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:57:12.500017 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:57:12.500084 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:57:12.500149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:57:12.802815 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:57:20.040241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:57:20.040319 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:57:20.040385 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:57:20.040453 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:57:20.040514 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:57:20.040574 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:57:20.040632 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:57:20.347074 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:57:41.264511 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:57:41.264596 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:57:41.264663 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:57:41.264731 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:57:41.264794 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:57:41.264854 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:57:41.264911 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:57:41.567081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:57:43.066432 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:57:43.066528 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:57:43.066613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:57:43.066689 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:57:43.066779 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:57:43.066850 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:57:43.066929 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:57:43.364154 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:58:11.829590 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:58:11.829687 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:58:11.829761 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:58:11.829838 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:58:11.829929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:58:11.830001 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:58:11.830063 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:58:12.154133 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:58:13.619934 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:58:13.620039 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:58:13.620122 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:58:13.620191 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:58:13.620263 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:58:13.620352 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:58:13.620435 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:58:13.929479 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:58:20.167010 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:58:20.167577 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:58:20.167674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:58:20.167757 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:58:20.167840 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:58:20.167925 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:58:20.168029 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:58:20.469920 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:58:42.424755 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:58:42.424840 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:58:42.424910 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:58:42.424969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:58:42.425036 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:58:42.425103 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:58:42.425175 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:58:42.728321 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:58:44.192076 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:58:44.192159 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:58:44.192227 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:58:44.192295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:58:44.192359 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:58:44.192421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:58:44.192484 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:58:44.503850 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:59:12.993510 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:59:12.993617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:59:12.993683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:59:12.993756 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:59:12.993822 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:59:12.993890 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:59:12.993955 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:59:13.294613 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:59:14.762468 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:59:14.762563 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:59:14.762641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:59:14.762733 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:59:14.762803 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:59:14.762893 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:59:14.762969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:59:15.066170 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:59:20.287212 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:59:20.287316 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:59:20.287398 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:59:20.287470 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:59:20.287547 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:59:20.287622 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:59:20.287696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:59:20.592014 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:59:43.554259 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:59:43.554353 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:59:43.554424 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:59:43.554490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:59:43.554553 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:59:43.554617 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:59:43.554686 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:59:43.863262 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 20:59:45.327796 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 20:59:45.327882 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 20:59:45.327953 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 20:59:45.328021 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 20:59:45.328091 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 20:59:45.328152 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 20:59:45.328220 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 20:59:45.629451 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:00:14.124030 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:00:14.124115 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:00:14.124187 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:00:14.124252 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:00:14.124318 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:00:14.124380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:00:14.124437 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:00:14.440270 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:00:15.892468 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:00:15.892571 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:00:15.892642 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:00:15.892709 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:00:15.892777 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:00:15.892843 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:00:15.892902 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:00:16.198171 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:00:20.412125 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:00:20.412202 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:00:20.412267 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:00:20.412328 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:00:20.412390 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:00:20.412447 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:00:20.412513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:00:20.718701 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:00:44.706157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:00:44.706239 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:00:44.706307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:00:44.706374 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:00:44.706435 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:00:44.706499 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:00:44.706573 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:00:45.022201 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:00:46.460602 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:00:46.460700 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:00:46.460803 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:00:46.460893 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:00:46.460977 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:00:46.461050 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:00:46.461130 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:00:46.764434 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:01:15.285849 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:01:15.285963 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:01:15.286037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:01:15.286107 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:01:15.286177 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:01:15.286258 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:01:15.286333 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:01:15.591069 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:01:17.025228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:01:17.025311 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:01:17.025389 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:01:17.025454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:01:17.025518 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:01:17.025578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:01:17.025640 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:01:17.331525 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:01:20.535730 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:01:20.535815 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:01:20.535879 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:01:20.535950 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:01:20.536012 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:01:20.536078 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:01:20.536138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:01:20.841422 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:01:45.849479 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:01:45.849570 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:01:45.849633 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:01:45.849703 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:01:45.849766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:01:45.849832 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:01:45.849892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:01:46.154229 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:01:47.593683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:01:47.593797 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:01:47.593878 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:01:47.593945 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:01:47.594022 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:01:47.594098 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:01:47.594170 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:01:47.909803 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:02:16.420729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:02:16.420824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:02:16.420893 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:02:16.420952 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:02:16.421018 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:02:16.421078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:02:16.421142 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:02:16.730109 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:02:18.175887 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:02:18.175972 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:02:18.176045 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:02:18.176104 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:02:18.176171 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:02:18.176232 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:02:18.176297 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:02:18.479340 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:02:20.656960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:02:20.657058 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:02:20.657140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:02:20.657219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:02:20.657297 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:02:20.657379 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:02:20.657454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:02:20.962761 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:02:46.994795 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:02:46.994914 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:02:46.994986 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:02:46.995067 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:02:46.995133 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:02:46.995207 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:02:46.995285 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:02:47.305069 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:02:48.743395 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:02:48.743475 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:02:48.743553 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:02:48.743620 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:02:48.743681 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:02:48.744753 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:02:48.745046 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:02:49.049235 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:03:17.568818 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:03:17.568909 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:03:17.568975 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:03:17.569055 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:03:17.569119 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:03:17.569186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:03:17.569247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:03:17.882261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:03:19.320139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:03:19.320246 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:03:19.320328 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:03:19.320410 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:03:19.320494 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:03:19.320572 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:03:19.320656 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:03:19.626410 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:03:20.775969 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:03:20.776060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:03:20.776137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:03:20.776212 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:03:20.776285 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:03:20.776364 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:03:20.776436 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:03:21.084325 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:03:48.142184 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:03:48.142269 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:03:48.142340 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:03:48.142401 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:03:48.142461 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:03:48.142532 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:03:48.142591 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:03:48.440808 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:03:49.889351 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:03:49.889454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:03:49.889538 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:03:49.889624 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:03:49.889696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:03:49.889780 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:03:49.889857 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:03:50.201564 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:04:18.713291 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:04:18.713378 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:04:18.713445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:04:18.713518 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:04:18.713576 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:04:18.713638 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:04:18.713703 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:04:19.022892 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:04:20.460633 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:04:20.460715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:04:20.460803 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:04:20.460865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:04:20.460928 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:04:20.460989 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:04:20.461055 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:04:20.765012 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:04:21.035753 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:04:21.035856 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:04:21.035922 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:04:21.035990 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:04:21.036065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:04:21.036130 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:04:21.036194 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:04:21.341371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:04:49.295711 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:04:49.295815 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:04:49.295876 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:04:49.295936 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:04:49.296001 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:04:49.296062 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:04:49.296123 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:04:49.618878 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:04:51.036691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:04:51.036800 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:04:51.036874 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:04:51.036951 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:04:51.037014 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:04:51.037079 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:04:51.037148 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:04:51.342879 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:05:19.890495 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:05:19.890580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:05:19.890656 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:05:19.890735 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:05:19.890802 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:05:19.890861 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:05:19.890922 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:05:20.210944 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:05:21.016777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:05:21.016857 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:05:21.016924 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:05:21.016988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:05:21.017052 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:05:21.017117 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:05:21.017179 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:05:21.324225 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:05:21.604967 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:05:21.605046 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:05:21.605114 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:05:21.605178 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:05:21.605246 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:05:21.605306 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:05:21.605368 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:05:21.920187 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:05:50.469949 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:05:50.470023 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:05:50.470090 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:05:50.470160 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:05:50.470232 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:05:50.470295 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:05:50.470359 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:05:50.768939 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:05:52.201957 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:05:52.202041 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:05:52.202107 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:05:52.202170 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:05:52.202234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:05:52.202294 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:05:52.202360 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:05:52.510338 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:06:21.027946 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:06:21.028050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:06:21.028136 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:06:21.028209 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:06:21.028275 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:06:21.028348 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:06:21.028421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:06:21.341153 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:06:21.605590 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:06:21.606162 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:06:21.606662 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:06:21.606769 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:06:21.606848 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:06:21.606943 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:06:21.607014 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:06:21.917034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:06:22.764040 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:06:22.764130 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:06:22.764198 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:06:22.764266 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:06:22.764335 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:06:22.764406 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:06:22.764468 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:06:23.068051 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:06:51.604237 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:06:51.604314 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:06:51.604392 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:06:51.604455 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:06:51.604515 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:06:51.604574 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:06:51.604638 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:06:51.916732 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:06:53.331059 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:06:53.331151 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:06:53.331223 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:06:53.331283 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:06:53.331353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:06:53.331415 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:06:53.331478 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:06:53.638673 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:07:21.263466 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:07:21.263547 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:07:21.263623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:07:21.263685 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:07:21.263753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:07:21.263822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:07:21.263878 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:07:21.568468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:07:22.201773 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:07:22.201867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:07:22.201935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:07:22.201998 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:07:22.202059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:07:22.202122 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:07:22.202184 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:07:22.508658 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:07:23.898056 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:07:23.898168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:07:23.899030 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:07:23.899252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:07:23.899851 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:07:23.900472 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:07:23.901039 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:07:24.212983 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:07:52.769920 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:07:52.770032 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:07:52.770094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:07:52.770161 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:07:52.770226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:07:52.770291 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:07:52.770353 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:07:53.076759 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:07:54.474531 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:07:54.474616 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:07:54.474684 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:07:54.474770 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:07:54.474835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:07:54.474920 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:07:54.474988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:07:54.779431 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:08:21.386512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:08:21.386590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:08:21.386653 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:08:21.386714 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:08:21.386781 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:08:21.386847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:08:21.386912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:08:21.693958 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:08:23.341841 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:08:23.341920 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:08:23.342002 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:08:23.342064 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:08:23.342125 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:08:23.342188 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:08:23.342253 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:08:23.650749 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:08:25.051354 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:08:25.051448 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:08:25.051511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:08:25.051570 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:08:25.051634 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:08:25.051701 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:08:25.051770 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:08:25.367395 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:08:53.908511 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:08:53.908594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:08:53.908658 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:08:53.908728 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:08:53.908786 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:08:53.908847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:08:53.908913 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:08:54.221383 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:08:55.623197 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:08:55.623281 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:08:55.623359 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:08:55.623426 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:08:55.623489 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:08:55.623549 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:08:55.623613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:08:55.926316 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:09:21.512334 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:09:21.512407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:09:21.512474 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:09:21.512545 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:09:21.512603 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:09:21.512666 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:09:21.512756 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:09:21.826816 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:09:24.474150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:09:24.474236 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:09:24.474304 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:09:24.474368 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:09:24.474430 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:09:24.474492 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:09:24.474552 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:09:24.779825 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:09:26.190435 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:09:26.190521 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:09:26.190590 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:09:26.190660 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:09:26.190732 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:09:26.190809 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:09:26.190869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:09:26.493942 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:09:55.052543 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:09:55.052629 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:09:55.052697 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:09:55.052774 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:09:55.052847 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:09:55.052919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:09:55.052986 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:09:55.365134 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:09:56.750231 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:09:56.750318 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:09:56.750397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:09:56.750455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:09:56.750521 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:09:56.750579 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:09:56.750641 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:09:57.057576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:10:21.633949 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:10:21.634028 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:10:21.634096 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:10:21.634163 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:10:21.634224 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:10:21.634290 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:10:21.634348 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:10:21.940952 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:10:25.625356 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:10:25.625437 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:10:25.625505 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:10:25.625583 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:10:25.625645 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:10:25.625712 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:10:25.625775 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:10:25.935648 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:10:27.323404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:10:27.323495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:10:27.323575 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:10:27.323636 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:10:27.323696 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:10:27.323762 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:10:27.323821 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:10:27.626380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:10:56.207421 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:10:56.207501 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:10:56.207568 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:10:56.207629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:10:56.207700 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:10:56.207768 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:10:56.207829 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:10:56.513475 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:10:57.887740 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:10:57.887834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:10:57.887908 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:10:57.887978 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:10:57.888068 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:10:57.888140 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:10:57.888207 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:10:58.187287 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:11:21.756011 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:11:21.756090 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:11:21.756158 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:11:21.756229 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:11:21.756292 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:11:21.756355 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:11:21.756417 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:11:22.087069 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:11:26.774093 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:11:26.774200 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:11:26.774268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:11:26.774327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:11:26.774391 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:11:26.774455 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:11:26.774535 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:11:27.084334 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:11:28.446548 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:11:28.446641 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:11:28.446732 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:11:28.446809 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:11:28.446890 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:11:28.446962 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:11:28.447044 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:11:28.749488 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:11:57.347399 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:11:57.347496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:11:57.347564 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:11:57.347644 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:11:57.347722 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:11:57.347800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:11:57.347870 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:11:57.654568 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:11:59.014982 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:11:59.015074 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:11:59.015153 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:11:59.015216 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:11:59.015279 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:11:59.015342 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:11:59.015402 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:11:59.321934 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:12:21.875172 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:12:21.875259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:12:21.875324 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:12:21.875397 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:12:21.875458 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:12:21.875522 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:12:21.875583 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:12:22.194527 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:12:27.914422 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:12:27.914528 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:12:27.914591 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:12:27.914654 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:12:27.914722 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:12:27.914790 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:12:27.914853 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:12:28.229161 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:12:29.585216 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:12:29.585329 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:12:29.585409 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:12:29.585490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:12:29.585565 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:12:29.585641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:12:29.585735 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:12:29.892434 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:12:58.493708 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:12:58.493811 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:12:58.493881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:12:58.493953 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:12:58.494026 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:12:58.494095 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:12:58.494165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:12:58.798100 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:13:00.154982 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:13:00.155064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:13:00.155126 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:13:00.155191 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:13:00.155260 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:13:00.155317 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:13:00.155392 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:13:00.467621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:13:21.999362 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:13:21.999435 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:13:21.999493 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:13:21.999563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:13:21.999622 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:13:21.999683 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:13:21.999745 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:13:22.314181 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:13:29.069101 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:13:29.069182 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:13:29.069245 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:13:29.069311 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:13:29.069372 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:13:29.069437 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:13:29.069497 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:13:29.378386 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:13:30.727060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:13:30.727194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:13:30.727267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:13:30.727338 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:13:30.727402 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:13:30.727473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:13:30.727536 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:13:31.049250 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:13:59.639742 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:13:59.639841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:13:59.639903 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:13:59.639964 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:13:59.640024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:13:59.640083 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:13:59.640140 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:13:59.949414 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:14:01.320233 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:14:01.320315 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:14:01.320377 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:14:01.320450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:14:01.320510 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:14:01.320568 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:14:01.320632 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:14:01.624506 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:14:22.128809 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:14:22.128900 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:14:22.128982 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:14:22.129072 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:14:22.129144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:14:22.129205 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:14:22.129267 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:14:22.435820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:14:30.219431 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:14:30.219528 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:14:30.219602 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:14:30.219664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:14:30.219737 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:14:30.219816 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:14:30.219877 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:14:30.522019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:14:31.883174 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:14:31.883256 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:14:31.883324 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:14:31.883385 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:14:31.883454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:14:31.883514 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:14:31.883578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:14:32.200630 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:15:00.779074 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:15:00.779155 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:15:00.779219 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:15:00.779284 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:15:00.779351 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:15:00.779410 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:15:00.779473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:15:01.086241 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:15:02.464403 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:15:02.464490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:15:02.464545 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:15:02.464625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:15:02.464683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:15:02.464757 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:15:02.464818 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:15:02.776584 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:15:22.253398 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:15:22.253497 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:15:22.253560 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:15:22.253626 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:15:22.253689 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:15:22.253761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:15:22.253824 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:15:22.557019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:15:31.348855 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:15:31.348950 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:15:31.349029 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:15:31.349101 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:15:31.349174 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:15:31.349263 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:15:31.349361 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:15:31.652581 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:15:33.047858 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:15:33.047963 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:15:33.048032 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:15:33.048099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:15:33.048166 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:15:33.048234 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:15:33.048301 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:15:33.357475 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:16:01.913418 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:16:01.913515 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:16:01.913612 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:16:01.913702 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:16:01.913797 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:16:01.913876 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:16:01.913973 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:16:02.226550 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:16:03.616242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:16:03.616349 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:16:03.616412 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:16:03.616486 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:16:03.616552 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:16:03.616633 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:16:03.616700 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:16:03.923919 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:16:22.384986 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:16:22.385083 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:16:22.385167 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:16:22.385246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:16:22.385337 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:16:22.385404 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:16:22.385487 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:16:22.696342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:16:32.484477 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:16:32.484596 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:16:32.484666 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:16:32.484764 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:16:32.484835 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:16:32.484915 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:16:32.484983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:16:32.796553 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:16:34.197760 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:16:34.197862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:16:34.197939 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:16:34.198029 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:16:34.198095 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:16:34.198181 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:16:34.198249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:16:34.519364 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:17:03.064275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:17:03.064362 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:17:03.064433 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:17:03.064495 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:17:03.064561 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:17:03.064622 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:17:03.064686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:17:03.368705 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:17:04.785029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:17:04.785120 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:17:04.785185 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:17:04.785261 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:17:04.785322 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:17:04.785387 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:17:04.785449 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:17:05.106738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:17:22.511527 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:17:22.511606 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:17:22.511680 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:17:22.511748 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:17:22.511821 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:17:22.511880 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:17:22.511945 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:17:22.824267 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:17:33.630779 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:17:33.630863 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:17:33.630929 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:17:33.630993 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:17:33.631060 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:17:33.631122 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:17:33.631190 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:17:33.941726 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:17:35.374961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:17:35.375088 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:17:35.375148 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:17:35.375209 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:17:35.375275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:17:35.375345 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:17:35.375404 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:17:35.685031 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:18:04.214540 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:18:04.214648 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:18:04.214716 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:18:04.214789 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:18:04.214856 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:18:04.214916 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:18:04.214974 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:18:04.524978 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:18:05.949407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:18:05.949509 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:18:05.949582 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:18:05.949671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:18:05.949761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:18:05.949845 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:18:05.949927 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:18:06.247775 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:18:22.642015 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:18:22.642096 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:18:22.642185 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:18:22.642256 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:18:22.642313 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:18:22.642378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:18:22.642452 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:18:22.950369 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:18:34.789916 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:18:34.790012 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:18:34.790077 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:18:34.790147 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:18:34.790209 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:18:34.790274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:18:34.790331 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:18:35.104398 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:18:36.498991 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:18:36.499081 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:18:36.499153 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:18:36.499224 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:18:36.499284 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:18:36.499346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:18:36.499406 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:18:36.802863 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:19:05.363178 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:19:05.363262 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:19:05.363329 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:19:05.363394 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:19:05.363459 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:19:05.363522 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:19:05.363585 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:19:05.673969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:19:07.066048 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:19:07.066134 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:19:07.066205 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:19:07.066274 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:19:07.066334 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:19:07.066403 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:19:07.066465 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:19:07.367609 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:19:22.768589 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:19:22.768668 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:19:22.768741 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:19:22.768808 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:19:22.768871 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:19:22.768939 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:19:22.768996 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:19:23.077809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:19:35.946993 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:19:35.947075 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:19:35.947142 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:19:35.947208 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:19:35.947271 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:19:35.947332 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:19:35.947390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:19:36.248799 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:19:37.629819 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:19:37.629898 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:19:37.629960 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:19:37.630027 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:19:37.630087 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:19:37.630148 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:19:37.630214 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:19:37.931895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:20:06.511361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:20:06.511439 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:20:06.511507 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:20:06.511572 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:20:06.511637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:20:06.511702 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:20:06.511772 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:20:06.819397 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:20:08.190446 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:20:08.190547 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:20:08.190609 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:20:08.190674 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:20:08.190740 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:20:08.190803 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:20:08.190861 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:20:08.498745 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:20:22.896545 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:20:22.896635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:20:22.896700 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:20:22.896777 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:20:22.896840 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:20:22.896898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:20:22.896957 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:20:23.199494 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:20:37.083289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:20:37.083368 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:20:37.083436 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:20:37.083506 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:20:37.083585 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:20:37.083647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:20:37.083709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:20:37.390942 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:20:38.759270 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:20:38.759368 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:20:38.759440 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:20:38.759501 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:20:38.759566 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:20:38.759622 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:20:38.759683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:20:39.064075 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:21:07.651240 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:21:07.651353 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:21:07.651416 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:21:07.651487 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:21:07.651543 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:21:07.651601 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:21:07.652545 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:21:07.954284 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:21:09.327023 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:21:09.327140 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:21:09.327207 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:21:09.327275 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:21:09.327339 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:21:09.327407 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:21:09.327474 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:21:09.637770 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:21:23.034646 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:21:23.034739 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:21:23.034807 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:21:23.034875 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:21:23.034944 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:21:23.035011 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:21:23.035075 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:21:23.345787 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:21:38.221147 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:21:38.221228 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:21:38.221298 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:21:38.221359 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:21:38.221425 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:21:38.221485 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:21:38.221548 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:21:38.529034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:21:39.895963 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:21:39.896054 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:21:39.896114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:21:39.896179 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:21:39.896236 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:21:39.896300 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:21:39.896360 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:21:40.219787 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:22:08.792120 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:22:08.792202 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:22:08.792282 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:22:08.792343 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:22:08.792407 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:22:08.792472 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:22:08.792539 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:22:09.095843 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:22:10.483018 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:22:10.483116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:22:10.483172 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:22:10.483254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:22:10.483326 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:22:10.483410 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:22:10.483476 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:22:10.786454 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:22:23.163474 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:22:23.163554 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:22:23.163630 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:22:23.163697 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:22:23.163780 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:22:23.163847 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:22:23.163904 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:22:23.475541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:22:39.356103 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:22:39.356179 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:22:39.356257 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:22:39.356319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:22:39.356379 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:22:39.356435 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:22:39.356501 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:22:39.659121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:22:41.055045 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:22:41.055132 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:22:41.055196 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:22:41.055261 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:22:41.055319 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:22:41.055376 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:22:41.055436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:22:41.362672 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:23:09.915566 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:23:09.915648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:23:09.915738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:23:09.915800 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:23:09.915859 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:23:09.915922 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:23:09.915983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:23:10.229862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:23:11.624730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:23:11.624822 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:23:11.624897 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:23:11.624961 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:23:11.625024 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:23:11.625081 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:23:11.625139 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:23:11.937867 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:23:23.291591 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:23:23.291664 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:23:23.291728 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:23:23.291801 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:23:23.291865 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:23:23.291930 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:23:23.291988 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:23:23.598581 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:23:40.495976 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:23:40.496063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:23:40.496129 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:23:40.496191 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:23:40.496258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:23:40.496324 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:23:40.496382 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:23:40.806731 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:23:42.214301 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:23:42.214403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:23:42.214462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:23:42.214528 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:23:42.214586 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:23:42.214650 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:23:42.214712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:23:42.523274 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:24:11.077549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:24:11.077636 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:24:11.077710 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:24:11.077780 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:24:11.077848 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:24:11.077908 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:24:11.077973 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:24:11.381943 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:24:12.786714 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:24:12.786818 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:24:12.786888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:24:12.786958 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:24:12.787015 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:24:12.787073 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:24:12.787136 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:24:13.098593 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:24:23.418034 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:24:23.418240 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:24:23.418441 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:24:23.419525 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:24:23.419635 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:24:23.419705 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:24:23.419785 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:24:23.727888 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:24:41.645082 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:24:41.645161 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:24:41.645240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:24:41.645302 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:24:41.645371 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:24:41.645439 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:24:41.645500 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:24:41.958230 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:24:43.360932 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:24:43.361012 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:24:43.361083 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:24:43.361157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:24:43.361223 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:24:43.361283 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:24:43.361345 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:24:43.664234 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:25:12.238759 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:25:12.238843 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:25:12.238927 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:25:12.238990 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:25:12.239052 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:25:12.239112 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:25:12.239185 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:25:12.549337 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:25:13.932348 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:25:13.932436 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:25:13.932507 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:25:13.932566 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:25:13.932635 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:25:13.932694 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:25:13.932775 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:25:14.248122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:25:23.542588 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:25:23.542669 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:25:23.542751 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:25:23.542814 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:25:23.542882 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:25:23.542948 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:25:23.543014 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:25:23.846511 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:25:42.812593 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:25:42.812678 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:25:42.812744 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:25:42.812820 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:25:42.812904 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:25:42.812958 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:25:42.813015 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:25:43.117045 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:25:44.512896 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:25:44.512984 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:25:44.513066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:25:44.513130 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:25:44.513194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:25:44.513259 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:25:44.513316 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:25:44.819154 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:26:13.383609 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:26:13.383688 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:26:13.383760 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:26:13.383823 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:26:13.383882 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:26:13.383941 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:26:13.384009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:26:13.687613 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:26:15.088997 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:26:15.089079 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:26:15.089161 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:26:15.089235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:26:15.089303 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:26:15.089360 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:26:15.089420 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:26:15.393600 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:26:23.668403 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:26:23.668489 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:26:23.668558 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:26:23.668622 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:26:23.668689 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:26:23.668770 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:26:23.668836 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:26:23.975058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:26:43.959208 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:26:43.959316 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:26:43.959376 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:26:43.959443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:26:43.959503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:26:43.959568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:26:43.959631 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:26:44.269946 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:26:45.654191 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:26:45.654297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:26:45.654367 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:26:45.654429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:26:45.654498 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:26:45.654566 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:26:45.654628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:26:45.955943 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:27:14.532979 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:27:14.533060 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:27:14.533121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:27:14.533183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:27:14.533250 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:27:14.533310 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:27:14.533370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:27:14.836029 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:27:16.214395 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:27:16.214487 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:27:16.214574 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:27:16.214639 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:27:16.214705 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:27:16.214772 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:27:16.214839 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:27:16.515536 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:27:23.795901 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:27:23.795988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:27:23.796051 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:27:23.796118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:27:23.796179 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:27:23.796241 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:27:23.796303 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:27:24.113334 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:27:45.098118 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:27:45.098212 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:27:45.098280 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:27:45.098340 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:27:45.098405 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:27:45.098463 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:27:45.098522 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:27:45.409801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:27:46.774122 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:27:46.774220 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:27:46.774291 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:27:46.774353 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:27:46.774416 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:27:46.774481 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:27:46.774545 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:27:47.092783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:28:15.665345 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:28:15.665437 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:28:15.665508 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:28:15.665571 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:28:15.665634 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:28:15.665696 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:28:15.665765 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:28:15.976078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:28:17.354405 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:28:17.354505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:28:17.354579 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:28:17.354656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:28:17.354725 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:28:17.354802 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:28:17.354868 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:28:17.661200 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:28:23.924280 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:28:23.924364 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:28:23.924442 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:28:23.924503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:28:23.924565 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:28:23.924619 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:28:23.924698 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:28:24.241774 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:28:46.239145 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:28:46.239238 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:28:46.239313 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:28:46.239371 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:28:46.239432 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:28:46.239492 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:28:46.239556 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:28:46.555442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:28:47.936977 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:28:47.937061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:28:47.937129 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:28:47.937202 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:28:47.937262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:28:47.937329 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:28:47.937387 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:28:48.242929 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:29:16.820581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:29:16.820675 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:29:16.820749 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:29:16.820810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:29:16.820874 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:29:16.820936 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:29:16.821000 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:29:17.130000 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:29:18.505287 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:29:18.505372 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:29:18.505437 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:29:18.505498 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:29:18.505556 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:29:18.505620 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:29:18.505682 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:29:18.808305 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:29:24.052287 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:29:24.052362 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:29:24.052429 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:29:24.052491 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:29:24.052553 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:29:24.052611 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:29:24.052673 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:29:24.361153 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:29:47.384579 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:29:47.384681 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:29:47.384753 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:29:47.384814 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:29:47.384880 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:29:47.384940 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:29:47.385005 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:29:47.695367 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:29:49.066666 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:29:49.066760 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:29:49.066826 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:29:49.066892 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:29:49.066960 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:29:49.067034 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:29:49.067103 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:29:49.378077 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:30:17.960288 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:30:17.960374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:30:17.960436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:30:17.960513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:30:17.960573 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:30:17.960635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:30:17.960696 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:30:18.262714 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:30:19.639648 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:30:19.639731 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:30:19.639797 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:30:19.639872 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:30:19.639932 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:30:19.639993 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:30:19.640054 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:30:19.945648 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:30:24.180768 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:30:24.180851 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:30:24.180922 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:30:24.180981 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:30:24.181048 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:30:24.181110 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:30:24.181174 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:30:24.490398 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:30:48.527425 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:30:48.527503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:30:48.527577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:30:48.527635 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:30:48.527698 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:30:48.527766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:30:48.527831 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:30:48.835709 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:30:50.211388 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:30:50.211474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:30:50.211544 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:30:50.211608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:30:50.211670 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:30:50.211735 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:30:50.211799 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:30:50.518364 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:31:19.100892 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:31:19.101971 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:31:19.102069 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:31:19.102142 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:31:19.102242 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:31:19.102311 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:31:19.102386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:31:19.404943 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:31:20.777217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:31:20.777303 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:31:20.777384 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:31:20.777452 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:31:20.777517 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:31:20.777582 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:31:20.777639 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:31:21.084528 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:31:24.309798 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:31:24.309884 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:31:24.309960 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:31:24.310023 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:31:24.310086 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:31:24.310143 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:31:24.310214 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:31:24.616308 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:31:49.664864 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:31:49.664948 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:31:49.665016 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:31:49.665078 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:31:49.665141 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:31:49.665203 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:31:49.665271 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:31:49.981650 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:31:51.351902 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:31:51.351985 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:31:51.352051 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:31:51.352125 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:31:51.352190 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:31:51.352252 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:31:51.352311 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:31:51.660325 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:32:20.267350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:32:20.267440 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:32:20.267504 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:32:20.267569 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:32:20.267628 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:32:20.267695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:32:20.267768 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:32:20.577269 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:32:21.923836 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:32:21.923949 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:32:21.924012 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:32:21.924904 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:32:21.925183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:32:21.925447 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:32:21.926444 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:32:22.237880 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:32:24.435880 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:32:24.435962 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:32:24.436028 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:32:24.436086 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:32:24.436152 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:32:24.436216 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:32:24.436282 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:32:24.742103 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:32:50.837976 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:32:50.838053 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:32:50.838121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:32:50.838183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:32:50.838244 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:32:50.838305 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:32:50.838369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:32:51.155758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:32:52.503146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:32:52.503230 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:32:52.503293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:32:52.503354 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:32:52.503413 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:32:52.503480 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:32:52.503536 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:32:52.812972 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:33:21.415961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:33:21.416075 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:33:21.416138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:33:21.416208 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:33:21.416273 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:33:21.416339 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:33:21.416400 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:33:21.718013 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:33:23.077831 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:33:23.077917 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:33:23.077984 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:33:23.078058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:33:23.078132 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:33:23.078195 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:33:23.078259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:33:23.385196 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:33:24.565794 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:33:24.566342 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:33:24.567304 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:33:24.567399 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:33:24.567468 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:33:24.567552 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:33:24.567622 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:33:24.870913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:33:51.993139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:33:51.993224 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:33:51.993289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:33:51.993357 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:33:51.993421 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:33:51.993486 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:33:51.993552 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:33:52.332121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:33:53.647592 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:33:53.647674 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:33:53.647759 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:33:53.647820 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:33:53.647886 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:33:53.647946 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:33:53.648004 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:33:53.954606 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:34:22.599706 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:34:22.599792 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:34:22.599850 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:34:22.599925 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:34:22.599982 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:34:22.600039 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:34:22.600098 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:34:22.905653 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:34:24.237066 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:34:24.237156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:34:24.237225 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:34:24.237288 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:34:24.237349 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:34:24.237411 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:34:24.237469 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:34:24.542147 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:34:24.806063 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:34:24.806142 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:34:24.806208 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:34:24.806275 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:34:24.806334 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:34:24.806395 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:34:24.806470 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:34:25.120310 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:34:53.166160 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:34:53.166243 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:34:53.166312 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:34:53.166372 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:34:53.166432 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:34:53.166488 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:34:53.166548 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:34:53.479284 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:34:54.807858 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:34:54.807952 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:34:54.808013 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:34:54.808077 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:34:54.808144 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:34:54.808207 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:34:54.808270 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:34:55.122543 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:35:23.745018 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:35:23.745108 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:35:23.745175 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:35:23.745237 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:35:23.745304 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:35:23.745365 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:35:23.745429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:35:24.059527 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:35:24.822900 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:35:24.822977 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:35:24.823050 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:35:24.823111 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:35:24.823173 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:35:24.823236 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:35:24.823297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:35:25.141029 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:35:25.409619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:35:25.409704 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:35:25.409784 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:35:25.409863 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:35:25.409928 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:35:25.409998 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:35:25.410071 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:35:25.722980 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:35:54.330768 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:35:54.330852 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:35:54.330907 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:35:54.330970 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:35:54.331439 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:35:54.331980 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:35:54.332153 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:35:54.640188 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:35:55.989372 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:35:55.989459 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:35:55.989531 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:35:55.989595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:35:55.989659 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:35:55.989722 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:35:55.989787 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:35:56.307504 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:36:24.905779 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:36:24.905867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:36:24.905930 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:36:24.905992 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:36:24.906052 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:36:24.906116 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:36:24.906178 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:36:25.224184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:36:25.484899 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:36:25.484979 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:36:25.485048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:36:25.485109 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:36:25.485173 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:36:25.485235 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:36:25.485295 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:36:25.785029 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:36:26.573509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:36:26.573592 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:36:26.573675 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:36:26.573741 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:36:26.573803 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:36:26.573862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:36:26.573923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:36:26.877212 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:36:55.486445 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:36:55.486537 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:36:55.486603 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:36:55.486659 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:36:55.486731 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:36:55.486797 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:36:55.486861 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:36:55.789607 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:36:57.145521 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:36:57.145632 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:36:57.145710 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:36:57.145787 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:36:57.145861 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:36:57.145934 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:36:57.146002 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:36:57.453536 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:37:25.080649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:37:25.080733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:37:25.080803 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:37:25.080867 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:37:25.080931 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:37:25.080994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:37:25.081059 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:37:25.386501 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:37:26.055265 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:37:26.055360 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:37:26.055418 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:37:26.055479 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:37:26.055542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:37:26.055600 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:37:26.055660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:37:26.358847 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:37:27.715302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:37:27.715388 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:37:27.715455 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:37:27.715518 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:37:27.715584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:37:27.715650 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:37:27.715716 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:37:28.019013 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:37:56.621331 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:37:56.621412 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:37:56.621495 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:37:56.621558 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:37:56.621622 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:37:56.621684 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:37:56.621757 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:37:56.933728 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:37:58.275627 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:37:58.275706 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:37:58.275795 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:37:58.275857 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:37:58.275929 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:37:58.275989 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:37:58.276057 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:37:58.583076 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:38:25.204701 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:38:25.204790 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:38:25.204867 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:38:25.204937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:38:25.205007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:38:25.205078 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:38:25.205146 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:38:25.511914 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:38:27.201170 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:38:27.201249 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:38:27.201317 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:38:27.201381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:38:27.201446 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:38:27.201509 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:38:27.201571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:38:27.506188 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:38:28.845901 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:38:28.846040 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:38:28.846119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:38:28.846199 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:38:28.846284 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:38:28.846356 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:38:28.846437 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:38:29.166086 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:38:57.762954 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:38:57.763072 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:38:57.763146 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:38:57.763218 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:38:57.763294 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:38:57.763367 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:38:57.763437 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:38:58.073122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:38:59.428922 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:38:59.429008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:38:59.429068 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:38:59.429142 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:38:59.429202 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:38:59.429267 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:38:59.429329 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:38:59.732857 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:39:25.331164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:39:25.331242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:39:25.331313 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:39:25.331378 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:39:25.331441 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:39:25.331504 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:39:25.331570 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:39:25.642761 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:39:28.335832 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:39:28.335940 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:39:28.336000 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:39:28.336061 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:39:28.336121 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:39:28.336183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:39:28.336244 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:39:28.642583 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:39:29.997147 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:39:29.997236 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:39:29.997305 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:39:29.997376 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:39:29.997439 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:39:29.997515 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:39:29.997584 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:39:30.313406 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:39:58.911667 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:39:58.911753 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:39:58.911823 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:39:58.911882 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:39:58.911947 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:39:58.912000 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:39:58.912070 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:39:59.222545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:40:00.580044 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:40:00.580144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:40:00.580211 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:40:00.580274 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:40:00.580329 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:40:00.580395 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:40:00.580457 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:40:00.884032 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:40:25.461319 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:40:25.461392 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:40:25.461457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:40:25.461520 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:40:25.461583 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:40:25.461643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:40:25.461705 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:40:25.766279 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:40:29.484427 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:40:29.484516 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:40:29.484591 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:40:29.484661 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:40:29.484736 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:40:29.484813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:40:29.484885 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:40:29.790034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:40:31.149235 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:40:31.149323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:40:31.149402 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:40:31.149467 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:40:31.149536 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:40:31.149597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:40:31.149656 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:40:31.460117 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:41:00.053464 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:41:00.053559 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:41:00.053631 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:41:00.053710 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:41:00.053786 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:41:00.053869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:41:00.053940 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:41:00.368732 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:41:01.722364 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:41:01.722448 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:41:01.722525 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:41:01.722594 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:41:01.722667 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:41:01.722733 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:41:01.722800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:41:02.068103 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:41:25.587340 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:41:25.587419 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:41:25.587490 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:41:25.587551 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:41:25.587613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:41:25.587672 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:41:25.588670 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:41:25.896924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:41:30.632665 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:41:30.632758 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:41:30.632845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:41:30.632917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:41:30.632985 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:41:30.633038 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:41:30.633102 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:41:30.943779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:41:32.340239 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:41:32.340341 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:41:32.340416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:41:32.340489 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:41:32.340559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:41:32.340631 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:41:32.340699 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:41:32.648140 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:42:01.211552 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:42:01.211631 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:42:01.211701 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:42:01.211781 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:42:01.211847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:42:01.211907 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:42:01.211968 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:42:01.520085 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:42:02.906766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:42:02.906849 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:42:02.906914 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:42:02.906986 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:42:02.907049 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:42:02.907110 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:42:02.907168 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:42:03.224130 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:42:25.716639 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:42:25.716712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:42:25.716795 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:42:25.716858 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:42:25.716922 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:42:25.716988 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:42:25.717047 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:42:26.023122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:42:31.785888 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:42:31.785998 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:42:31.786079 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:42:31.786149 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:42:31.786226 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:42:31.786302 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:42:31.786381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:42:32.092346 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:42:33.486020 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:42:33.486102 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:42:33.486176 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:42:33.486246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:42:33.486314 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:42:33.486378 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:42:33.486440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:42:33.793793 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:43:02.368135 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:43:02.368243 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:43:02.368317 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:43:02.368380 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:43:02.368445 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:43:02.368508 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:43:02.368572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:43:02.669707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:43:04.051484 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:43:04.051576 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:43:04.051641 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:43:04.051700 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:43:04.051771 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:43:04.051845 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:43:04.051906 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:43:04.354378 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:43:25.844644 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:43:25.844725 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:43:25.844796 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:43:25.844865 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:43:25.844931 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:43:25.844992 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:43:25.845053 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:43:26.145335 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:43:32.934306 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:43:32.934390 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:43:32.934457 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:43:32.934531 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:43:32.934587 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:43:32.934660 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:43:32.934726 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:43:33.246744 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:43:34.640643 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:43:34.640737 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:43:34.640835 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:43:34.640906 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:43:34.640976 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:43:34.641067 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:43:34.641135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:43:34.951658 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:44:03.507656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:44:03.507742 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:44:03.507808 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:44:03.507883 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:44:03.507951 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:44:03.508013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:44:03.508079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:44:03.816004 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:44:05.216334 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:44:05.216430 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:44:05.216500 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:44:05.216570 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:44:05.216636 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:44:05.216698 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:44:05.216769 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:44:05.528725 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:44:25.964474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:44:25.964551 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:44:25.964615 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:44:25.964676 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:44:25.964749 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:44:25.964816 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:44:25.964878 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:44:26.272936 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:44:34.085239 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:44:34.085362 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:44:34.085425 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:44:34.085487 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:44:34.085550 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:44:34.085608 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:44:34.085673 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:44:34.385567 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:44:35.786610 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:44:35.786726 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:44:35.786788 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:44:35.786847 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:44:35.786905 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:44:35.786961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:44:35.787030 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:44:36.098161 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:45:04.649754 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:45:04.649841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:45:04.649906 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:45:04.649980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:45:04.650042 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:45:04.650107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:45:04.650168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:45:04.964096 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:45:06.364232 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:45:06.364321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:45:06.364386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:45:06.364450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:45:06.364511 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:45:06.364575 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:45:06.364638 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:45:06.672630 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:45:26.085807 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:45:26.085889 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:45:26.085963 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:45:26.086033 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:45:26.086101 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:45:26.086164 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:45:26.086223 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:45:26.395330 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:45:35.227060 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:45:35.227161 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:45:35.227226 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:45:35.227295 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:45:35.227357 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:45:35.227415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:45:35.227482 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:45:35.528080 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:45:36.934002 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:45:36.934088 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:45:36.934158 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:45:36.934215 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:45:36.934281 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:45:36.934342 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:45:36.934408 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:45:37.239161 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:46:05.790515 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:46:05.790611 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:46:05.790675 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:46:05.790742 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:46:05.790810 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:46:05.791753 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:46:05.792050 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:46:06.098310 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:46:07.498668 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:46:07.498758 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:46:07.498823 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:46:07.498889 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:46:07.498953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:46:07.499018 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:46:07.499085 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:46:07.801213 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:46:26.206648 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:46:26.206739 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:46:26.206800 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:46:26.206865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:46:26.206925 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:46:26.206990 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:46:26.207049 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:46:26.513838 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:46:36.352445 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:46:36.352533 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:46:36.352597 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:46:36.352657 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:46:36.352726 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:46:36.352790 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:46:36.352854 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:46:36.663903 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:46:38.060372 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:46:38.060462 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:46:38.060535 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:46:38.060603 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:46:38.060662 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:46:38.060731 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:46:38.060810 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:46:38.360436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:47:06.922838 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:47:06.922926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:47:06.922995 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:47:06.923076 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:47:06.923135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:47:06.923206 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:47:06.923262 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:47:07.236799 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:47:08.620982 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:47:08.621064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:47:08.621124 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:47:08.621203 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:47:08.621275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:47:08.621356 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:47:08.621426 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:47:08.928395 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:47:26.321710 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:47:26.321795 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:47:26.321861 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:47:26.321927 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:47:26.321996 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:47:26.322058 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:47:26.322123 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:47:26.632507 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:47:37.499671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:47:37.499774 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:47:37.499843 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:47:37.499907 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:47:37.499970 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:47:37.500025 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:47:37.500091 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:47:37.807611 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:47:39.193468 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:47:39.193556 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:47:39.193620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:47:39.193683 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:47:39.193758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:47:39.193817 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:47:39.193881 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:47:39.501385 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:48:08.072199 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:48:08.072296 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:48:08.072360 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:48:08.072419 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:48:08.072480 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:48:08.072541 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:48:08.072603 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:48:08.383206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:48:09.763312 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:48:09.763394 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:48:09.763464 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:48:09.763529 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:48:09.763591 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:48:09.763651 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:48:09.763724 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:48:10.073242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:48:26.450231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:48:26.450311 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:48:26.450378 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:48:26.450447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:48:26.450511 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:48:26.450579 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:48:26.450640 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:48:26.752228 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:48:38.642228 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:48:38.642311 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:48:38.642386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:48:38.642454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:48:38.642513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:48:38.642576 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:48:38.642641 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:48:38.959295 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:48:40.341864 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:48:40.341952 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:48:40.342019 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:48:40.342086 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:48:40.342145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:48:40.342205 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:48:40.342266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:48:40.639446 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:49:09.227832 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:49:09.227922 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:49:09.227987 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:49:09.228048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:49:09.228109 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:49:09.228172 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:49:09.228236 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:49:09.534450 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:49:10.898675 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:49:10.898769 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:49:10.898830 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:49:10.898897 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:49:10.898956 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:49:10.899016 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:49:10.899080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:49:11.202116 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:49:26.570919 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:49:26.571005 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:49:26.571071 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:49:26.571144 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:49:26.571204 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:49:26.571269 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:49:26.572102 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:49:26.880061 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:49:39.800543 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:49:39.800628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:49:39.800693 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:49:39.800761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:49:39.800826 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:49:39.800890 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:49:39.800951 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:49:40.116164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:49:41.468356 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:49:41.468459 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:49:41.468555 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:49:41.468634 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:49:41.468711 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:49:41.468800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:49:41.468884 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:49:41.779774 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:50:10.377767 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:50:10.377877 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:50:10.377962 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:50:10.378026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:50:10.378084 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:50:10.378148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:50:10.378207 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:50:10.684732 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:50:12.048234 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:50:12.048330 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:50:12.048399 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:50:12.048458 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:50:12.048519 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:50:12.048582 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:50:12.048646 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:50:12.359002 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:50:26.692590 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:50:26.692670 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:50:26.692747 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:50:26.692819 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:50:26.692881 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:50:26.692949 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:50:26.693014 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:50:27.011612 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:50:40.950245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:50:40.950326 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:50:40.950389 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:50:40.950456 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:50:40.950519 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:50:40.950581 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:50:40.950646 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:50:41.254273 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:50:42.621854 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:50:42.621931 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:50:42.622004 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:50:42.622063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:50:42.622127 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:50:42.622192 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:50:42.622253 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:50:42.923742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:51:11.521452 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:51:11.521534 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:51:11.521603 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:51:11.521667 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:51:11.521738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:51:11.521802 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:51:11.521861 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:51:11.832044 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:51:13.189649 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:51:13.189742 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:51:13.189803 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:51:13.189867 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:51:13.189933 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:51:13.189991 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:51:13.190061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:51:13.491856 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:51:26.818599 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:51:26.818682 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:51:26.818753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:51:26.818818 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:51:26.818881 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:51:26.818951 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:51:26.819015 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:51:27.121536 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:51:42.101196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:51:42.101284 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:51:42.101359 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:51:42.101427 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:51:42.101498 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:51:42.101562 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:51:42.101631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:51:42.426304 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:51:43.754012 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:51:43.754087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:51:43.754149 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:51:43.754226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:51:43.754290 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:51:43.754348 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:51:43.754408 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:51:44.058397 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:52:12.695283 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:52:12.695365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:52:12.695443 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:52:12.695502 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:52:12.695563 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:52:12.695622 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:52:12.695686 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:52:13.005581 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:52:14.320666 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:52:14.320787 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:52:14.320850 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:52:14.320912 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:52:14.320978 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:52:14.321037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:52:14.321098 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:52:14.629792 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:52:26.941853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:52:26.941932 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:52:26.941993 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:52:26.942056 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:52:26.942124 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:52:26.942187 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:52:26.942254 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:52:27.252623 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:52:43.273380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:52:43.273465 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:52:43.273527 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:52:43.273605 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:52:43.273666 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:52:43.273732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:52:43.273793 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:52:43.576864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:52:44.894044 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:52:44.894121 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:52:44.894181 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:52:44.894249 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:52:44.894309 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:52:44.894377 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:52:44.894434 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:52:45.212505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:53:13.838480 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:53:13.838578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:53:13.838643 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:53:13.838713 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:53:13.838781 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:53:13.838849 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:53:13.838910 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:53:14.151661 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:53:15.471779 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:53:15.471861 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:53:15.471936 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:53:15.472000 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:53:15.472062 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:53:15.472123 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:53:15.472193 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:53:15.780846 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:53:27.063593 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:53:27.063673 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:53:27.063762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:53:27.063827 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:53:27.063898 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:53:27.063961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:53:27.064029 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:53:27.373121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:53:44.408791 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:53:44.408878 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:53:44.408942 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:53:44.409013 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:53:44.409081 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:53:44.409143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:53:44.409203 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:53:44.714776 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:53:46.045351 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:53:46.045436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:53:46.045499 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:53:46.045570 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:53:46.045636 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:53:46.045700 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:53:46.045769 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:53:46.347618 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:54:14.975600 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:54:14.975693 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:54:14.975782 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:54:14.975854 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:54:14.975930 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:54:14.976002 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:54:14.976091 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:54:15.282090 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:54:16.611474 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:54:16.611553 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:54:16.611638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:54:16.611699 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:54:16.611768 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:54:16.611827 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:54:16.611885 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:54:16.916603 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:54:27.185272 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:54:27.185352 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:54:27.185413 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:54:27.185475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:54:27.185537 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:54:27.185605 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:54:27.185664 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:54:27.493140 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:54:45.538390 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:54:45.538479 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:54:45.538553 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:54:45.538624 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:54:45.538690 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:54:45.538757 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:54:45.538819 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:54:45.845230 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:54:47.175969 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:54:47.176063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:54:47.176118 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:54:47.176183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:54:47.176239 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:54:47.176297 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:54:47.176350 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:54:47.478266 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:55:16.105984 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:55:16.106069 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:55:16.106147 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:55:16.106217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:55:16.106278 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:55:16.106365 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:55:16.106436 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:55:16.411240 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:55:17.743286 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:55:17.743362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:55:17.743447 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:55:17.743511 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:55:17.743577 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:55:17.743638 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:55:17.743704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:55:18.060490 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:55:27.306462 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:55:27.306536 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:55:27.306597 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:55:27.306661 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:55:27.306728 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:55:27.306788 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:55:27.306852 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:55:27.612159 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:55:46.671298 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:55:46.671384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:55:46.671459 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:55:46.671524 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:55:46.671592 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:55:46.671655 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:55:46.671712 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:55:46.984576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:55:48.320267 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:55:48.320360 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:55:48.320437 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:55:48.320503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:55:48.320575 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:55:48.320643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:55:48.320709 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:55:48.623943 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:56:17.250853 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:56:17.250943 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:56:17.251012 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:56:17.251080 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:56:17.251142 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:56:17.251208 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:56:17.251270 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:56:17.562527 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:56:18.886119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:56:18.886209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:56:18.886273 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:56:18.886345 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:56:18.886415 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:56:18.886480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:56:18.886534 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:56:19.211853 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:56:27.422252 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:56:27.422334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:56:27.422408 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:56:27.422467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:56:27.422532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:56:27.422592 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:56:27.422656 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:56:27.728263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:56:47.826786 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:56:47.826908 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:56:47.826969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:56:47.827029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:56:47.827086 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:56:47.827151 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:56:47.827214 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:56:48.138306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:56:49.492828 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:56:49.492923 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:56:49.492985 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:56:49.493052 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:56:49.493112 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:56:49.493172 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:56:49.493233 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:56:49.803274 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:57:18.401072 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:57:18.401208 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:57:18.401313 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:57:18.401412 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:57:18.401514 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:57:18.401616 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:57:18.401706 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:57:18.708591 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:57:20.093498 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:57:20.093584 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:57:20.093650 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:57:20.093706 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:57:20.093776 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:57:20.093837 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:57:20.093905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:57:20.399465 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:57:27.545546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:57:27.545631 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:57:27.545695 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:57:27.545767 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:57:27.545831 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:57:27.545901 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:57:27.545966 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:57:27.856506 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:57:48.970241 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:57:48.970324 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:57:48.970392 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:57:48.970459 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:57:48.970520 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:57:48.970582 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:57:48.970643 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:57:49.284177 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:57:50.660838 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:57:50.660916 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:57:50.660977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:57:50.661041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:57:50.661114 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:57:50.661169 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:57:50.661235 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:57:50.968027 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:58:19.547063 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:58:19.547149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:58:19.547219 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:58:19.547280 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:58:19.547342 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:58:19.547405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:58:19.547480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:58:19.858509 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:58:21.240384 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:58:21.240498 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:58:21.240576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:58:21.240654 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:58:21.240745 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:58:21.240823 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:58:21.240896 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:58:21.543900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:58:27.667958 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:58:27.668050 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:58:27.668128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:58:27.668211 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:58:27.668282 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:58:27.668353 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:58:27.668425 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:58:27.972086 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:58:50.130574 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:58:50.130659 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:58:50.130728 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:58:50.130804 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:58:50.130864 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:58:50.130924 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:58:50.130985 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:58:50.442322 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:58:51.828099 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:58:51.828210 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:58:51.828277 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:58:51.828333 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:58:51.828399 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:58:51.828457 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:58:51.828519 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:58:52.143310 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:59:20.709197 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:59:20.709283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:59:20.709358 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:59:20.709424 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:59:20.709487 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:59:20.709549 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:59:20.709613 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:59:21.016045 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:59:22.404040 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:59:22.404128 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:59:22.404207 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:59:22.404274 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:59:22.404340 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:59:22.404400 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:59:22.404462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:59:22.716452 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:59:27.784466 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:59:27.784552 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:59:27.784617 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:59:27.784683 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:59:27.784749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:59:27.784818 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:59:27.784879 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:59:28.092001 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:59:51.278354 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:59:51.278457 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:59:51.278521 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:59:51.278588 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:59:51.278651 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:59:51.278716 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:59:51.278781 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:59:51.590726 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 21:59:52.977816 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 21:59:52.977902 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 21:59:52.977967 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 21:59:52.978032 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 21:59:52.978096 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 21:59:52.978154 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 21:59:52.978219 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 21:59:53.286163 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:00:21.856669 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:00:21.856766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:00:21.856840 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:00:21.856905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:00:21.856964 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:00:21.857029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:00:21.857085 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:00:22.161372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:00:23.546099 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:00:23.546179 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:00:23.546251 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:00:23.546321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:00:23.546387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:00:23.546446 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:00:23.546510 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:00:23.861163 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:00:27.904750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:00:27.904828 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:00:27.904898 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:00:27.904963 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:00:27.905021 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:00:27.905078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:00:27.905139 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:00:28.214601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:00:52.428760 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:00:52.428877 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:00:52.428958 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:00:52.429029 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:00:52.429088 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:00:52.429159 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:00:52.429215 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:00:52.741876 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:00:54.120495 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:00:54.120577 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:00:54.120643 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:00:54.120707 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:00:54.120782 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:00:54.120846 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:00:54.120910 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:00:54.439129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:01:23.007766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:01:23.007873 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:01:23.007937 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:01:23.007996 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:01:23.008059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:01:23.008125 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:01:23.008186 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:01:23.316254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:01:24.699219 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:01:24.699311 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:01:24.699389 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:01:24.699452 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:01:24.699524 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:01:24.699580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:01:24.699640 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:01:25.005951 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:01:28.021544 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:01:28.021619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:01:28.021688 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:01:28.021766 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:01:28.021833 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:01:28.021891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:01:28.021955 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:01:28.343823 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:01:53.578403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:01:53.578484 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:01:53.578552 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:01:53.578614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:01:53.579552 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:01:53.580468 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:01:53.580906 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:01:53.884421 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:01:55.275538 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:01:55.275632 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:01:55.275701 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:01:55.275774 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:01:55.275839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:01:55.275900 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:01:55.275964 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:01:55.578910 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:02:24.146032 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:02:24.146108 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:02:24.146181 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:02:24.146244 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:02:24.146308 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:02:24.146372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:02:24.146438 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:02:24.455145 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:02:25.841544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:02:25.841628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:02:25.841705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:02:25.841771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:02:25.841835 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:02:25.841895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:02:25.841959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:02:26.155577 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:02:28.144848 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:02:28.144947 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:02:28.145010 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:02:28.145082 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:02:28.145156 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:02:28.145215 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:02:28.145280 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:02:28.458192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:02:54.713581 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:02:54.713680 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:02:54.713754 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:02:54.713815 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:02:54.713886 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:02:54.713943 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:02:54.714004 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:02:55.026686 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:02:56.426222 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:02:56.426333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:02:56.426403 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:02:56.426475 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:02:56.426548 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:02:56.426622 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:02:56.426689 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:02:56.739272 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:03:25.297440 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:03:25.297539 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:03:25.297606 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:03:25.297672 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:03:25.297747 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:03:25.297813 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:03:25.297876 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:03:25.602494 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:03:27.003019 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:03:27.003104 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:03:27.003170 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:03:27.003239 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:03:27.003300 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:03:27.003364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:03:27.003426 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:03:27.309369 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:03:28.266413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:03:28.266503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:03:28.266567 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:03:28.266634 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:03:28.266696 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:03:28.266768 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:03:28.266831 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:03:28.570442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:03:55.861465 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:03:55.861595 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:03:55.861677 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:03:55.861780 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:03:55.861857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:03:55.861925 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:03:55.862006 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:03:56.166839 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:03:57.569223 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:03:57.569323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:03:57.569415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:03:57.569496 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:03:57.569570 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:03:57.569651 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:03:57.569735 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:03:57.880830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:04:26.425763 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:04:26.425932 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:04:26.426088 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:04:26.426236 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:04:26.426383 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:04:26.426544 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:04:26.427143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:04:26.736184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:04:28.142982 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:04:28.143069 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:04:28.143131 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:04:28.143195 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:04:28.143260 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:04:28.143323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:04:28.143386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:04:28.458874 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:04:28.719207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:04:28.719298 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:04:28.719386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:04:28.719464 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:04:28.719550 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:04:28.719625 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:04:28.719708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:04:29.030383 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:04:56.999865 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:04:56.999951 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:04:57.000017 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:04:57.000095 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:04:57.000159 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:04:57.000231 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:04:57.000304 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:04:57.302312 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:04:58.720933 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:04:58.721036 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:04:58.721110 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:04:58.721189 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:04:58.721266 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:04:58.721345 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:04:58.721417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:04:59.031991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:05:27.566283 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:05:27.566392 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:05:27.566501 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:05:27.566594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:05:27.566686 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:05:27.566778 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:05:27.566865 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:05:27.874447 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:05:28.509685 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:05:28.509776 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:05:28.509844 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:05:28.509914 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:05:28.509976 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:05:28.510040 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:05:28.510102 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:05:28.820056 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:05:29.301941 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:05:29.302048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:05:29.302119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:05:29.302179 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:05:29.302247 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:05:29.302309 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:05:29.302375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:05:29.604143 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:05:58.139912 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:05:58.140023 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:05:58.140107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:05:58.140197 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:05:58.140260 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:05:58.140327 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:05:58.140397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:05:58.443291 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:05:59.868222 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:05:59.868305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:05:59.868390 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:05:59.868462 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:05:59.868533 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:05:59.868610 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:05:59.868678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:06:00.177031 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:06:28.629085 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:06:28.629184 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:06:28.629250 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:06:28.629317 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:06:28.629379 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:06:28.629452 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:06:28.629516 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:06:28.953693 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:06:29.236294 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:06:29.236410 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:06:29.236494 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:06:29.236580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:06:29.236662 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:06:29.236751 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:06:29.236903 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:06:29.539164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:06:30.442268 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:06:30.442379 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:06:30.442461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:06:30.442541 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:06:30.442629 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:06:30.442713 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:06:30.442802 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:06:30.745922 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:06:59.235310 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:06:59.235396 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:06:59.235471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:06:59.235542 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:06:59.235614 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:06:59.235675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:06:59.235756 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:06:59.541576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:07:01.005601 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:07:01.005690 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:07:01.005763 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:07:01.005829 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:07:01.005891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:07:01.005960 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:07:01.006017 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:07:01.320754 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:07:28.749156 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:07:28.749234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:07:28.749302 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:07:28.749366 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:07:28.749426 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:07:28.749484 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:07:28.749560 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:07:29.062359 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:07:29.800834 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:07:29.800922 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:07:29.801002 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:07:29.801073 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:07:29.801152 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:07:29.801222 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:07:29.801286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:07:30.110962 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:07:31.583481 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:07:31.583558 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:07:31.583622 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:07:31.583685 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:07:31.583758 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:07:31.583818 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:07:31.583878 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:07:31.891037 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:08:00.371825 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:08:00.371917 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:08:00.371974 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:08:00.372044 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:08:00.372108 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:08:00.372172 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:08:00.372231 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:08:00.670911 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:08:02.169882 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:08:02.169962 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:08:02.170028 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:08:02.170094 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:08:02.170158 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:08:02.170217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:08:02.170280 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:08:02.477407 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:08:28.865983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:08:28.866068 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:08:28.866135 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:08:28.866200 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:08:28.866264 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:08:28.866330 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:08:28.866395 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:08:29.177118 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:08:30.929998 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:08:30.930082 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:08:30.930157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:08:30.930222 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:08:30.930288 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:08:30.930346 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:08:30.930414 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:08:31.239756 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:08:32.740451 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:08:32.740996 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:08:32.741467 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:08:32.741926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:08:32.742020 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:08:32.742090 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:08:32.742180 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:08:33.061380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:09:01.505468 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:09:01.505557 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:09:01.505629 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:09:01.505690 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:09:01.505766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:09:01.505831 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:09:01.505897 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:09:01.809625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:09:03.322408 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:09:03.322530 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:09:03.322592 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:09:03.322654 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:09:03.322716 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:09:03.322785 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:09:03.322846 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:09:03.633057 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:09:28.982059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:09:28.982141 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:09:28.982205 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:09:28.982274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:09:28.982338 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:09:28.982403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:09:28.982462 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:09:29.293307 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:09:32.083444 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:09:32.083536 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:09:32.083612 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:09:32.083682 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:09:32.083777 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:09:32.083851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:09:32.083925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:09:32.406856 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:09:33.894266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:09:33.894348 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:09:33.894416 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:09:33.894482 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:09:33.894554 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:09:33.894617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:09:33.894682 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:09:34.220229 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:10:02.676333 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:10:02.676432 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:10:02.676501 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:10:02.677517 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:10:02.677912 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:10:02.678404 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:10:02.679733 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:10:02.977603 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:10:04.479802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:10:04.479886 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:10:04.479954 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:10:04.480016 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:10:04.480079 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:10:04.480141 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:10:04.480204 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:10:04.789756 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:10:29.104353 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:10:29.104453 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:10:29.104533 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:10:29.104606 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:10:29.104690 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:10:29.104773 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:10:29.104853 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:10:29.421619 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:10:33.245874 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:10:33.245983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:10:33.246055 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:10:33.246124 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:10:33.246194 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:10:33.246263 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:10:33.246336 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:10:33.546555 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:10:35.060959 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:10:35.061045 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:10:35.061114 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:10:35.061183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:10:35.061249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:10:35.061316 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:10:35.061379 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:10:35.368597 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:11:03.808378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:11:03.808493 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:11:03.808572 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:11:03.808632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:11:03.808703 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:11:03.808772 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:11:03.808838 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:11:04.116704 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:11:05.635654 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:11:05.635757 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:11:05.635823 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:11:05.635892 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:11:05.635975 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:11:05.636057 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:11:05.636121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:11:05.944084 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:11:29.223131 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:11:29.223218 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:11:29.223286 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:11:29.223352 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:11:29.223411 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:11:29.223473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:11:29.223533 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:11:29.528812 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:11:34.398276 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:11:34.398386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:11:34.398469 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:11:34.398546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:11:34.398631 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:11:34.398706 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:11:34.398799 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:11:34.695021 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:11:36.210976 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:11:36.211084 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:11:36.211167 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:11:36.211247 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:11:36.211328 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:11:36.211400 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:11:36.211484 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:11:36.510554 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:12:04.957338 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:12:04.957457 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:12:04.957529 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:12:04.957604 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:12:04.957672 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:12:04.957746 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:12:04.957813 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:12:05.276002 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:12:06.772636 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:12:06.772728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:12:06.772793 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:12:06.772859 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:12:06.772929 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:12:06.772992 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:12:06.773065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:12:07.079045 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:12:29.344470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:12:29.344559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:12:29.344635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:12:29.344724 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:12:29.344795 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:12:29.344870 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:12:29.344947 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:12:29.648059 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:12:35.543363 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:12:35.543469 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:12:35.543536 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:12:35.543601 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:12:35.543660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:12:35.543738 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:12:35.543799 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:12:35.844545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:12:37.337256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:12:37.337346 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:12:37.337413 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:12:37.337481 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:12:37.337561 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:12:37.337623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:12:37.337688 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:12:37.644188 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:13:06.110657 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:13:06.110744 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:13:06.110810 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:13:06.110875 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:13:06.110939 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:13:06.111001 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:13:06.111074 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:13:06.413939 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:13:07.908282 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:13:07.908377 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:13:07.908445 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:13:07.908512 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:13:07.908576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:13:07.908635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:13:07.908700 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:13:08.222414 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:13:29.461657 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:13:29.461761 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:13:29.461839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:13:29.461915 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:13:29.461988 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:13:29.462049 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:13:29.462109 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:13:29.768145 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:13:36.677063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:13:36.677162 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:13:36.677228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:13:36.677297 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:13:36.677361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:13:36.677429 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:13:36.677494 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:13:36.991582 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:13:38.484171 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:13:38.484255 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:13:38.484312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:13:38.484392 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:13:38.484450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:13:38.484519 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:13:38.484577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:13:38.786160 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:14:07.257404 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:14:07.257517 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:14:07.257578 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:14:07.257641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:14:07.257703 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:14:07.257770 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:14:07.257825 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:14:07.565974 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:14:09.046648 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:14:09.046768 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:14:09.046836 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:14:09.046901 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:14:09.046969 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:14:09.047046 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:14:09.047111 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:14:09.356272 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:14:29.588114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:14:29.588198 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:14:29.588255 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:14:29.588320 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:14:29.588390 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:14:29.588454 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:14:29.588515 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:14:29.897493 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:14:37.828250 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:14:37.828935 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:14:37.829028 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:14:37.829098 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:14:37.829196 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:14:37.829282 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:14:37.829352 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:14:38.133892 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:14:39.619345 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:14:39.619429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:14:39.619494 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:14:39.619557 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:14:39.619615 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:14:39.619674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:14:39.619739 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:14:39.925373 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:15:08.394218 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:15:08.394309 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:15:08.394379 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:15:08.394441 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:15:08.394501 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:15:08.394561 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:15:08.394621 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:15:08.698207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:15:10.186530 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:15:10.186619 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:15:10.186682 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:15:10.186764 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:15:10.186825 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:15:10.186907 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:15:10.186962 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:15:10.495143 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:15:29.708075 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:15:29.708155 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:15:29.708230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:15:29.708292 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:15:29.708352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:15:29.708419 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:15:29.708490 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:15:30.011420 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:15:38.958797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:15:38.958908 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:15:38.958971 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:15:38.959060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:15:38.959119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:15:38.959181 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:15:38.959235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:15:39.279232 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:15:40.752772 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:15:40.752884 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:15:40.752984 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:15:40.753052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:15:40.753136 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:15:40.753202 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:15:40.753267 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:15:41.058265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:16:09.541502 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:16:09.541607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:16:09.541680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:16:09.541762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:16:09.541822 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:16:09.541886 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:16:09.541952 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:16:09.847270 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:16:11.332933 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:16:11.333021 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:16:11.333088 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:16:11.333152 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:16:11.333213 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:16:11.333279 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:16:11.333337 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:16:11.640492 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:16:29.834077 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:16:29.834174 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:16:29.834243 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:16:29.834309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:16:29.834381 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:16:29.834444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:16:29.834508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:16:30.152834 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:16:40.122105 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:16:40.122188 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:16:40.122257 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:16:40.122322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:16:40.122390 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:16:40.122452 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:16:40.122516 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:16:40.430019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:16:41.900257 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:16:41.900342 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:16:41.900409 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:16:41.900477 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:16:41.900540 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:16:41.900610 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:16:41.900672 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:16:42.219316 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:17:10.690316 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:17:10.690423 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:17:10.690483 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:17:10.690550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:17:10.690607 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:17:10.690668 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:17:10.690739 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:17:10.995207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:17:12.475902 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:17:12.475985 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:17:12.476065 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:17:12.476129 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:17:12.476193 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:17:12.476252 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:17:12.476310 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:17:12.778275 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:17:29.958877 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:17:29.958963 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:17:29.959035 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:17:29.959099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:17:29.959167 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:17:29.959233 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:17:29.959301 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:17:30.270865 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:17:41.260833 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:17:41.260930 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:17:41.260994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:17:41.261059 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:17:41.261120 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:17:41.261180 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:17:41.261242 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:17:41.567603 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:17:43.041246 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:17:43.041327 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:17:43.041399 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:17:43.041475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:17:43.041535 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:17:43.041608 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:17:43.041666 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:17:43.352962 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:18:11.833929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:18:11.834010 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:18:11.834081 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:18:11.834142 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:18:11.834208 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:18:11.835022 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:18:11.835422 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:18:12.157861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:18:13.622241 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:18:13.622326 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:18:13.622393 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:18:13.622475 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:18:13.622533 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:18:13.622598 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:18:13.622660 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:18:13.930543 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:18:30.081905 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:18:30.081979 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:18:30.082046 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:18:30.082106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:18:30.082171 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:18:30.082236 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:18:30.082299 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:18:30.393828 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:18:42.417900 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:18:42.417980 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:18:42.418053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:18:42.418124 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:18:42.418180 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:18:42.418241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:18:42.418303 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:18:42.720779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:18:44.189962 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:18:44.190052 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:18:44.190120 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:18:44.190189 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:18:44.190249 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:18:44.190309 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:18:44.190366 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:18:44.493206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:19:12.989660 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:19:12.989752 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:19:12.989828 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:19:12.989886 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:19:12.989963 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:19:12.990029 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:19:12.990090 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:19:13.302184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:19:14.752919 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:19:14.753199 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:19:14.753413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:19:14.753569 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:19:14.753734 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:19:14.754036 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:19:14.754928 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:19:15.062979 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:19:30.204568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:19:30.204653 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:19:30.204724 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:19:30.204794 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:19:30.204859 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:19:30.204925 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:19:30.204992 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:19:30.514068 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:19:43.565431 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:19:43.565510 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:19:43.565573 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:19:43.565645 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:19:43.565711 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:19:43.565776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:19:43.565843 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:19:43.867193 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:19:45.325046 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:19:45.325129 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:19:45.325197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:19:45.325262 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:19:45.325324 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:19:45.325386 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:19:45.325450 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:19:45.630658 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:20:14.125392 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:20:14.125483 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:20:14.125547 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:20:14.125614 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:20:14.125678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:20:14.125755 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:20:14.125815 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:20:14.452590 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:20:15.893823 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:20:15.893903 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:20:15.893983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:20:15.894058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:20:15.894124 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:20:15.894184 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:20:15.894246 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:20:16.199468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:20:30.338883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:20:30.338978 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:20:30.339076 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:20:30.339153 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:20:30.339236 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:20:30.339298 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:20:30.339372 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:20:30.646133 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:20:44.708694 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:20:44.708776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:20:44.708852 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:20:44.708917 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:20:44.708982 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:20:44.709042 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:20:44.709106 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:20:45.018124 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:20:46.462200 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:20:46.462283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:20:46.462350 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:20:46.462416 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:20:46.462479 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:20:46.462542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:20:46.462603 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:20:46.765157 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:21:15.288745 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:21:15.288832 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:21:15.288914 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:21:15.288977 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:21:15.289038 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:21:15.289098 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:21:15.289161 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:21:15.598029 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:21:17.031053 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:21:17.031135 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:21:17.031216 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:21:17.031283 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:21:17.031355 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:21:17.031422 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:21:17.031483 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:21:17.337256 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:21:30.466349 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:21:30.466424 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:21:30.466489 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:21:30.466550 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:21:30.466612 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:21:30.466679 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:21:30.466747 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:21:30.761829 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:21:45.858414 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:21:45.858508 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:21:45.858574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:21:45.858650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:21:45.858724 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:21:45.858794 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:21:45.858854 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:21:46.165988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:21:47.602572 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:21:47.602652 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:21:47.602727 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:21:47.602801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:21:47.602870 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:21:47.602934 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:21:47.602996 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:21:47.911257 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:22:16.429423 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:22:16.429519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:22:16.429595 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:22:16.429652 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:22:16.429713 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:22:16.429785 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:22:16.429851 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:22:16.738807 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:22:18.177894 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:22:18.177980 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:22:18.178048 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:22:18.178107 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:22:18.178170 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:22:18.178228 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:22:18.178293 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:22:18.480815 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:22:30.592697 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:22:30.592784 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:22:30.592856 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:22:30.592917 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:22:30.592984 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:22:30.593047 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:22:30.593111 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:22:30.891855 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:22:39.490922 E | op-osd: failed to update cluster "ocs-storagecluster-cephcluster" Storage. failed to update object "openshift-storage/ocs-storagecluster-cephcluster" status: Operation cannot be fulfilled on cephclusters.ceph.rook.io "ocs-storagecluster-cephcluster": the object has been modified; please apply your changes to the latest version and try again >2022-11-23 22:22:46.998860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:22:46.998945 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:22:46.999012 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:22:46.999072 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:22:46.999134 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:22:46.999197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:22:46.999260 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:22:47.311133 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:22:48.745951 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:22:48.746029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:22:48.746086 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:22:48.746152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:22:48.746213 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:22:48.746273 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:22:48.746336 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:22:49.052290 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:23:17.570775 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:23:17.570858 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:23:17.570936 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:23:17.570996 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:23:17.571058 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:23:17.571120 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:23:17.571180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:23:17.888288 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:23:19.314912 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:23:19.314996 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:23:19.315073 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:23:19.315142 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:23:19.315204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:23:19.315268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:23:19.315327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:23:19.620276 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:23:30.716379 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:23:30.716453 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:23:30.716520 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:23:30.716587 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:23:30.716650 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:23:30.716703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:23:30.716772 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:23:31.020304 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:23:48.150023 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:23:48.150102 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:23:48.151073 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:23:48.151304 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:23:48.151954 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:23:48.152674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:23:48.152910 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:23:48.456245 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:23:49.885629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:23:49.885715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:23:49.885785 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:23:49.885856 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:23:49.885923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:23:49.885995 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:23:49.886061 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:23:50.224074 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:24:18.714436 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:24:18.714531 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:24:18.714613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:24:18.714693 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:24:18.714776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:24:18.714852 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:24:18.714932 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:24:19.021142 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:24:20.486130 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:24:20.486232 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:24:20.486330 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:24:20.486412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:24:20.486488 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:24:20.486567 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:24:20.486651 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:24:20.796502 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:24:30.846604 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:24:30.846724 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:24:30.846798 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:24:30.846871 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:24:30.846941 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:24:30.847009 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:24:30.847085 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:24:31.154099 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:24:49.295037 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:24:49.295119 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:24:49.295187 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:24:49.295255 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:24:49.295316 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:24:49.295379 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:24:49.295441 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:24:49.598406 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:24:51.052629 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:24:51.052730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:24:51.052792 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:24:51.052860 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:24:51.052923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:24:51.052984 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:24:51.053052 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:24:51.361473 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:25:19.863283 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:25:19.863375 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:25:19.863446 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:25:19.863521 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:25:19.863583 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:25:19.863650 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:25:19.863709 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:25:20.181078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:25:21.623606 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:25:21.623687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:25:21.623774 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:25:21.623843 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:25:21.623909 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:25:21.623977 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:25:21.624040 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:25:21.929764 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:25:30.968032 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:25:30.968111 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:25:30.968178 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:25:30.968238 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:25:30.968305 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:25:30.968365 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:25:30.968429 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:25:31.275058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:25:50.444490 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:25:50.444576 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:25:50.444643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:25:50.444721 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:25:50.444802 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:25:50.444875 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:25:50.444937 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:25:50.748292 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:25:52.206572 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:25:52.206662 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:25:52.206736 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:25:52.206804 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:25:52.206868 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:25:52.206928 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:25:52.206987 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:25:52.510137 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:26:21.012828 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:26:21.012906 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:26:21.012983 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:26:21.013049 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:26:21.013119 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:26:21.013184 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:26:21.013246 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:26:21.325020 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:26:22.767852 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:26:22.767942 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:26:22.768005 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:26:22.768067 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:26:22.768129 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:26:22.768194 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:26:22.768259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:26:23.072173 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:26:31.095146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:26:31.095229 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:26:31.095295 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:26:31.095363 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:26:31.095425 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:26:31.095482 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:26:31.095541 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:26:31.407320 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:26:51.586091 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:26:51.586200 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:26:51.586268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:26:51.586326 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:26:51.586386 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:26:51.586449 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:26:51.586511 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:26:51.891219 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:26:53.334123 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:26:53.334209 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:26:53.334282 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:26:53.334356 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:26:53.334417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:26:53.334475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:26:53.334537 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:26:53.635931 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:27:22.168329 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:27:22.168521 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:27:22.168683 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:27:22.168827 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:27:22.169366 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:27:22.169653 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:27:22.170313 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:27:22.481508 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:27:23.899106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:27:23.899200 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:27:23.899274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:27:23.899346 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:27:23.899408 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:27:23.899475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:27:23.899533 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:27:24.229367 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:27:31.215609 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:27:31.215687 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:27:31.215758 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:27:31.215822 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:27:31.215883 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:27:31.215944 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:27:31.216007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:27:31.521013 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:27:52.737733 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:27:52.737838 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:27:52.737903 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:27:52.737970 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:27:52.738038 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:27:52.738094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:27:52.738155 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:27:53.044834 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:27:54.495606 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:27:54.495688 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:27:54.495782 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:27:54.495849 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:27:54.495913 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:27:54.495982 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:27:54.496044 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:27:54.801251 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:28:23.307901 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:28:23.307998 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:28:23.308062 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:28:23.308121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:28:23.308184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:28:23.308245 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:28:23.308312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:28:23.615642 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:28:25.063849 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:28:25.063936 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:28:25.064003 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:28:25.064061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:28:25.064135 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:28:25.064197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:28:25.064268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:28:25.374583 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:28:31.343737 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:28:31.343818 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:28:31.343883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:28:31.343943 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:28:31.344000 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:28:31.344055 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:28:31.344118 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:28:31.650896 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:28:53.875908 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:28:53.875996 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:28:53.876071 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:28:53.876137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:28:53.876200 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:28:53.876271 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:28:53.876335 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:28:54.187467 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:28:55.632870 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:28:55.632950 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:28:55.633024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:28:55.633089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:28:55.633154 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:28:55.633205 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:28:55.633265 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:28:55.931924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:29:24.445256 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:29:24.445341 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:29:24.445402 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:29:24.445466 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:29:24.445538 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:29:24.445600 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:29:24.445664 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:29:24.750348 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:29:26.191897 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:29:26.191979 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:29:26.192039 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:29:26.192110 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:29:26.192170 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:29:26.192231 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:29:26.192293 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:29:26.502721 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:29:31.468204 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:29:31.468899 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:29:31.468986 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:29:31.469056 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:29:31.469124 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:29:31.469217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:29:31.469287 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:29:31.772991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:29:55.011880 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:29:55.011962 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:29:55.012046 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:29:55.012108 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:29:55.012169 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:29:55.012231 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:29:55.012296 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:29:55.326592 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:29:56.760438 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:29:56.760518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:29:56.760593 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:29:56.760652 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:29:56.760715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:29:56.760786 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:29:56.760847 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:29:57.066752 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:30:25.584474 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:30:25.584556 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:30:25.584638 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:30:25.584701 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:30:25.584770 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:30:25.584827 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:30:25.584891 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:30:25.884250 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:30:27.336220 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:30:27.336306 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:30:27.336374 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:30:27.336438 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:30:27.336498 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:30:27.336563 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:30:27.336617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:30:27.649343 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:30:31.589353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:30:31.589447 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:30:31.589519 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:30:31.589583 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:30:31.589659 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:30:31.589745 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:30:31.589812 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:30:31.909912 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:30:56.149203 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:30:56.149289 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:30:56.149358 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:30:56.149423 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:30:56.149482 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:30:56.149550 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:30:56.149618 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:30:56.460064 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:30:57.909030 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:30:57.909125 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:30:57.909207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:30:57.909286 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:30:57.909364 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:30:57.909430 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:30:57.909507 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:30:58.213874 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:31:26.722351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:31:26.722459 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:31:26.722535 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:31:26.722615 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:31:26.722682 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:31:26.722822 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:31:26.722894 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:31:27.032756 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:31:28.475169 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:31:28.475266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:31:28.475346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:31:28.475416 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:31:28.475491 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:31:28.475571 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:31:28.475663 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:31:28.778438 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:31:31.713167 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:31:31.713277 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:31:31.713359 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:31:31.713443 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:31:31.713531 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:31:31.713613 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:31:31.713697 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:31:32.026730 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:31:57.296357 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:31:57.296454 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:31:57.296532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:31:57.296607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:31:57.296680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:31:57.296784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:31:57.296860 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:31:57.601300 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:31:59.044425 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:31:59.044521 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:31:59.044596 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:31:59.044680 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:31:59.044780 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:31:59.044865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:31:59.044944 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:31:59.350627 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:32:27.869475 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:32:27.869591 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:32:27.869659 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:32:27.869746 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:32:27.869817 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:32:27.869885 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:32:27.869956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:32:28.181656 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:32:29.608166 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:32:29.608267 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:32:29.608335 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:32:29.608393 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:32:29.608458 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:32:29.608518 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:32:29.608581 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:32:29.906289 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:32:31.835311 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:32:31.835402 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:32:31.835461 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:32:31.835525 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:32:31.835585 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:32:31.835646 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:32:31.835710 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:32:32.151648 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:32:58.447435 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:32:58.447510 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:32:58.447584 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:32:58.447642 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:32:58.447723 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:32:58.447783 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:32:58.447847 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:32:58.758426 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:33:00.178373 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:33:00.178477 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:33:00.178562 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:33:00.178623 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:33:00.178690 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:33:00.178764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:33:00.178828 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:33:00.479471 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:33:29.028965 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:33:29.029091 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:33:29.029178 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:33:29.029254 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:33:29.029334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:33:29.029413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:33:29.029493 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:33:29.342660 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:33:30.741028 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:33:30.741132 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:33:30.741204 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:33:30.741285 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:33:30.741358 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:33:30.741434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:33:30.741502 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:33:31.039080 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:33:31.961961 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:33:31.962067 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:33:31.962152 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:33:31.962230 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:33:31.962310 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:33:31.962389 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:33:31.962470 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:33:32.283223 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:33:59.609793 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:33:59.609914 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:33:59.609994 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:33:59.610074 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:33:59.610154 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:33:59.610238 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:33:59.610320 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:33:59.917757 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:34:01.306510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:34:01.306600 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:34:01.306669 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:34:01.306765 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:34:01.306843 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:34:01.306905 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:34:01.306975 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:34:01.610872 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:34:30.187181 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:34:30.187269 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:34:30.187336 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:34:30.187400 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:34:30.187466 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:34:30.187531 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:34:30.187598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:34:30.494930 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:34:31.868432 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:34:31.868510 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:34:31.868592 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:34:31.868653 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:34:31.868732 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:34:31.868792 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:34:31.868872 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:34:32.184870 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:34:32.448680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:34:32.448799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:34:32.448880 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:34:32.448948 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:34:32.449009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:34:32.449074 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:34:32.449135 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:34:32.749166 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:35:00.758432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:35:00.758513 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:35:00.758591 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:35:00.758661 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:35:00.758729 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:35:00.758798 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:35:00.758855 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:35:01.055236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:35:02.449202 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:35:02.449301 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:35:02.449365 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:35:02.449424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:35:02.449494 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:35:02.449559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:35:02.449625 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:35:02.751071 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:35:31.319143 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:35:31.319257 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:35:31.319319 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:35:31.319381 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:35:31.320324 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:35:31.320511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:35:31.320682 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:35:31.622066 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:35:32.213736 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:35:32.213816 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:35:32.213880 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:35:32.213941 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:35:32.213999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:35:32.214069 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:35:32.214131 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:35:32.519959 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:35:33.008134 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:35:33.008211 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:35:33.008273 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:35:33.008334 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:35:33.008400 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:35:33.008461 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:35:33.008525 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:35:33.314329 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:36:01.883989 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:36:01.884078 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:36:01.884156 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:36:01.884213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:36:01.884271 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:36:01.884334 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:36:01.884397 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:36:02.196122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:36:03.574009 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:36:03.574088 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:36:03.574155 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:36:03.574219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:36:03.574284 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:36:03.574347 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:36:03.574403 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:36:03.879129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:36:32.348883 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:36:32.348965 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:36:32.349032 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:36:32.349092 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:36:32.349158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:36:32.349221 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:36:32.349284 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:36:32.652516 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:36:32.915395 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:36:32.915525 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:36:32.915607 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:36:32.915687 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:36:32.915780 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:36:32.915861 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:36:32.915952 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:36:33.218972 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:36:34.142769 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:36:34.142894 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:36:34.142980 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:36:34.143061 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:36:34.143139 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:36:34.143220 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:36:34.143292 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:36:34.446359 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:37:02.913495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:37:02.913585 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:37:02.913649 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:37:02.913713 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:37:02.913782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:37:02.913845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:37:02.913903 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:37:03.221752 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:37:04.705005 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:37:04.705113 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:37:04.705171 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:37:04.705239 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:37:04.705304 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:37:04.705364 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:37:04.705423 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:37:05.018507 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:37:32.476108 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:37:32.476194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:37:32.476268 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:37:32.476331 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:37:32.476393 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:37:32.476459 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:37:32.476519 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:37:32.779319 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:37:33.492145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:37:33.492233 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:37:33.492306 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:37:33.492386 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:37:33.492462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:37:33.492545 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:37:33.492624 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:37:33.794040 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:37:35.284395 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:37:35.285244 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:37:35.285360 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:37:35.285438 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:37:35.285511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:37:35.285586 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:37:35.285654 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:37:35.595490 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:38:04.060158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:38:04.060241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:38:04.060303 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:38:04.060368 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:38:04.060433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:38:04.060500 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:38:04.060560 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:38:04.373461 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:38:05.853172 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:38:05.853265 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:38:05.853335 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:38:05.853394 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:38:05.853455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:38:05.853517 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:38:05.853578 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:38:06.151527 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:38:32.606771 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:38:32.606849 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:38:32.606921 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:38:32.606981 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:38:32.607046 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:38:32.607106 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:38:32.607165 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:38:32.908840 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:38:34.636812 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:38:34.636895 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:38:34.636963 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:38:34.637027 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:38:34.637096 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:38:34.637164 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:38:34.637230 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:38:34.948836 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:38:36.412094 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:38:36.412187 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:38:36.412261 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:38:36.412339 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:38:36.412396 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:38:36.412458 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:38:36.412515 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:38:36.714201 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:39:05.218727 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:39:05.218839 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:39:05.218905 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:39:05.218972 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:39:05.219038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:39:05.219101 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:39:05.219160 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:39:05.521407 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:39:06.968588 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:39:06.968694 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:39:06.968767 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:39:06.968829 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:39:06.968892 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:39:06.968951 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:39:06.969009 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:39:07.281685 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:39:32.737140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:39:32.737216 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:39:32.737284 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:39:32.737348 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:39:32.737416 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:39:32.737477 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:39:32.737537 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:39:33.053779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:39:35.782629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:39:35.782713 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:39:35.782783 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:39:35.782854 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:39:35.782917 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:39:35.782973 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:39:35.783038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:39:36.085646 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:39:37.543158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:39:37.543241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:39:37.543303 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:39:37.543367 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:39:37.543427 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:39:37.543489 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:39:37.543558 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:39:37.856823 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:40:06.353215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:40:06.353803 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:40:06.353888 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:40:06.353965 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:40:06.354033 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:40:06.354120 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:40:06.354185 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:40:06.658088 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:40:08.136472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:40:08.136568 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:40:08.136649 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:40:08.136710 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:40:08.136778 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:40:08.136845 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:40:08.136914 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:40:08.446050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:40:32.863767 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:40:32.863867 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:40:32.863947 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:40:32.864016 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:40:32.864086 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:40:32.864153 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:40:32.864228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:40:33.168024 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:40:36.916082 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:40:36.916176 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:40:36.916239 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:40:36.916303 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:40:36.916366 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:40:36.916427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:40:36.916487 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:40:37.227209 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:40:38.708474 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:40:38.708558 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:40:38.708626 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:40:38.708686 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:40:38.708761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:40:38.708822 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:40:38.708881 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:40:39.015564 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:41:07.484960 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:41:07.485037 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:41:07.485104 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:41:07.485172 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:41:07.485234 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:41:07.485293 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:41:07.485359 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:41:07.792439 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:41:09.289693 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:41:09.289788 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:41:09.289855 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:41:09.289918 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:41:09.290664 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:41:09.290831 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:41:09.291015 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:41:09.596213 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:41:32.992265 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:41:32.992359 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:41:32.992435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:41:32.992507 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:41:32.992568 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:41:32.992639 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:41:32.992723 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:41:33.309384 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:41:38.051004 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:41:38.051120 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:41:38.051190 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:41:38.051250 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:41:38.051316 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:41:38.051374 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:41:38.051436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:41:38.358751 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:41:39.882704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:41:39.882787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:41:39.882861 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:41:39.882920 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:41:39.882978 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:41:39.883042 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:41:39.883107 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:41:40.202751 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:42:08.621018 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:42:08.621107 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:42:08.621180 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:42:08.621249 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:42:08.621308 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:42:08.621376 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:42:08.621436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:42:08.929293 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:42:10.465397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:42:10.465504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:42:10.465588 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:42:10.465675 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:42:10.465762 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:42:10.465840 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:42:10.465911 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:42:10.776489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:42:33.124918 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:42:33.125005 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:42:33.125083 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:42:33.125164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:42:33.125234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:42:33.125323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:42:33.125396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:42:33.442135 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:42:39.192295 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:42:39.192377 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:42:39.192443 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:42:39.192508 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:42:39.192583 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:42:39.192647 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:42:39.192710 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:42:39.507646 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:42:41.038699 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:42:41.038790 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:42:41.038861 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:42:41.038924 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:42:41.039003 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:42:41.039065 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:42:41.039125 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:42:41.349173 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:43:09.769434 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:43:09.769517 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:43:09.769583 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:43:09.769657 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:43:09.769732 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:43:09.769825 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:43:09.769906 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:43:10.095066 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:43:11.611770 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:43:11.611855 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:43:11.611921 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:43:11.611985 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:43:11.612046 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:43:11.612104 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:43:11.612165 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:43:11.924115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:43:33.246852 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:43:33.246929 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:43:33.246998 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:43:33.247061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:43:33.247126 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:43:33.247198 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:43:33.247258 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:43:33.555565 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:43:40.359272 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:43:40.359671 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:43:40.360049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:43:40.360738 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:43:40.361405 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:43:40.361502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:43:40.361572 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:43:40.666517 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:43:42.208566 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:43:42.208656 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:43:42.208727 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:43:42.208802 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:43:42.208868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:43:42.208933 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:43:42.208994 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:43:42.515268 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:44:10.932131 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:44:10.932224 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:44:10.932289 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:44:10.932352 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:44:10.932414 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:44:10.932472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:44:10.932527 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:44:11.244243 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:44:12.779566 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:44:12.779659 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:44:12.779728 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:44:12.779793 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:44:12.779854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:44:12.779913 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:44:12.779972 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:44:13.083780 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:44:33.369616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:44:33.369703 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:44:33.369791 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:44:33.369850 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:44:33.369913 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:44:33.369976 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:44:33.370038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:44:33.675028 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:44:41.509666 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:44:41.509763 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:44:41.509826 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:44:41.509884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:44:41.509959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:44:41.510023 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:44:41.510085 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:44:41.820072 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:44:43.348266 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:44:43.348387 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:44:43.348460 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:44:43.348535 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:44:43.348613 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:44:43.348702 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:44:43.348849 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:44:43.656625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:45:12.103026 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:45:12.103137 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:45:12.103222 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:45:12.103313 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:45:12.103405 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:45:12.103490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:45:12.103580 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:45:12.420581 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:45:13.923366 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:45:13.923477 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:45:13.923554 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:45:13.923628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:45:13.923705 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:45:13.923781 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:45:13.923851 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:45:14.230074 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:45:33.491433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:45:33.491512 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:45:33.491580 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:45:33.491645 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:45:33.491708 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:45:33.491782 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:45:33.491852 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:45:33.802021 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:45:42.677970 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:45:42.678051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:45:42.678121 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:45:42.678185 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:45:42.678255 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:45:42.678315 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:45:42.678383 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:45:42.980915 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:45:44.493421 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:45:44.493509 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:45:44.493588 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:45:44.493653 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:45:44.493715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:45:44.493795 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:45:44.493858 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:45:44.798150 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:46:13.238602 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:46:13.238697 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:46:13.238765 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:46:13.238835 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:46:13.238906 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:46:13.238975 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:46:13.239040 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:46:13.547805 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:46:15.057523 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:46:15.057644 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:46:15.057725 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:46:15.057820 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:46:15.057889 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:46:15.057959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:46:15.058022 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:46:15.360671 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:46:33.617943 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:46:33.618018 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:46:33.618085 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:46:33.618145 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:46:33.618215 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:46:33.618275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:46:33.618354 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:46:33.925853 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:46:43.810420 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:46:43.810534 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:46:43.810595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:46:43.810664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:46:43.810729 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:46:43.810800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:46:43.810859 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:46:44.112389 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:46:45.622559 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:46:45.622642 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:46:45.622711 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:46:45.622781 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:46:45.622841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:46:45.622903 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:46:45.622971 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:46:45.921448 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:47:14.390750 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:47:14.390825 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:47:14.390885 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:47:14.390949 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:47:14.391013 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:47:14.391070 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:47:14.391130 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:47:14.698533 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:47:16.177140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:47:16.177234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:47:16.177296 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:47:16.177359 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:47:16.177437 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:47:16.177501 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:47:16.177562 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:47:16.480236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:47:33.744579 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:47:33.744659 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:47:33.744731 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:47:33.744796 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:47:33.744858 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:47:33.744935 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:47:33.744996 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:47:34.048266 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:47:44.965618 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:47:44.965710 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:47:44.965777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:47:44.965838 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:47:44.965915 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:47:44.965980 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:47:44.966039 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:47:45.273598 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:47:46.743031 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:47:46.743136 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:47:46.743217 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:47:46.743300 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:47:46.743379 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:47:46.743471 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:47:46.743557 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:47:47.045990 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:48:15.535469 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:48:15.535576 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:48:15.535658 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:48:15.535763 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:48:15.535850 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:48:15.535937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:48:15.536012 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:48:15.843299 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:48:17.310277 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:48:17.310363 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:48:17.310440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:48:17.310519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:48:17.310610 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:48:17.310695 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:48:17.310777 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:48:17.617130 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:48:33.869332 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:48:33.869418 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:48:33.869485 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:48:33.869554 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:48:33.869619 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:48:33.869687 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:48:33.869760 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:48:34.176296 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:48:46.098700 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:48:46.098798 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:48:46.098869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:48:46.098934 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:48:46.099001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:48:46.099063 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:48:46.099130 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:48:46.402480 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:48:47.889162 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:48:47.889260 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:48:47.889325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:48:47.889401 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:48:47.889463 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:48:47.889522 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:48:47.889585 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:48:48.189494 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:49:16.664833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:49:16.664911 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:49:16.664988 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:49:16.665048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:49:16.665114 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:49:16.665174 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:49:16.665238 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:49:16.969731 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:49:18.453848 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:49:18.453954 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:49:18.454017 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:49:18.454091 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:49:18.454155 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:49:18.454222 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:49:18.454283 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:49:18.762810 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:49:33.987509 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:49:33.987602 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:49:33.987680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:49:33.987757 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:49:33.987817 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:49:33.987888 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:49:33.987958 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:49:34.295696 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:49:47.238782 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:49:47.238864 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:49:47.238933 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:49:47.238991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:49:47.239055 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:49:47.239118 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:49:47.239181 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:49:47.545603 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:49:49.025519 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:49:49.025607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:49:49.025684 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:49:49.025756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:49:49.025819 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:49:49.025879 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:49:49.025941 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:49:49.337914 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:50:17.809474 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:50:17.809555 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:50:17.809617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:50:17.809684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:50:17.809753 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:50:17.809819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:50:17.809887 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:50:18.111354 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:50:19.600220 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:50:19.600315 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:50:19.600385 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:50:19.600453 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:50:19.600511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:50:19.600573 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:50:19.600639 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:50:19.908420 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:50:34.112634 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:50:34.112753 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:50:34.112853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:50:34.112938 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:50:34.113028 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:50:34.113114 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:50:34.113219 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:50:34.441922 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:50:48.370075 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:50:48.370169 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:50:48.370239 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:50:48.370313 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:50:48.370398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:50:48.370472 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:50:48.370542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:50:48.674296 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:50:50.183349 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:50:50.183501 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:50:50.183608 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:50:50.183715 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:50:50.183828 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:50:50.183942 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:50:50.184049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:50:50.489250 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:51:18.929086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:51:18.929172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:51:18.929246 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:51:18.929309 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:51:18.929379 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:51:18.929439 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:51:18.929503 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:51:19.234218 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:51:20.748644 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:51:20.748738 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:51:20.748807 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:51:20.748880 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:51:20.748943 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:51:20.749005 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:51:20.749066 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:51:21.047604 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:51:34.236653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:51:34.236742 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:51:34.236805 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:51:34.236872 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:51:34.237659 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:51:34.237845 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:51:34.238054 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:51:34.550417 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:51:49.498364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:51:49.498457 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:51:49.498535 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:51:49.498602 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:51:49.498667 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:51:49.498746 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:51:49.498815 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:51:49.804891 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:51:51.308044 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:51:51.308139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:51:51.308207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:51:51.308267 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:51:51.308330 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:51:51.308392 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:51:51.308455 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:51:51.620606 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:52:20.088422 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:52:20.088542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:52:20.088629 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:52:20.088732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:52:20.088819 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:52:20.088905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:52:20.088987 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:52:20.399902 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:52:21.885031 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:52:21.885117 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:52:21.885212 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:52:21.885282 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:52:21.885351 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:52:21.885449 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:52:21.885531 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:52:22.202049 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:52:34.359574 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:52:34.359669 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:52:34.359740 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:52:34.359803 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:52:34.359866 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:52:34.359936 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:52:34.359992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:52:34.668195 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:52:50.660784 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:52:50.660872 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:52:50.660932 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:52:50.660996 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:52:50.661069 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:52:50.661127 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:52:50.661193 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:52:50.969637 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:52:52.460305 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:52:52.460402 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:52:52.460467 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:52:52.460531 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:52:52.460597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:52:52.460655 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:52:52.460721 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:52:52.770988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:53:21.232681 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:53:21.232808 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:53:21.232887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:53:21.232981 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:53:21.233066 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:53:21.233143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:53:21.233219 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:53:21.539075 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:53:23.035363 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:53:23.035458 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:53:23.035540 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:53:23.035621 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:53:23.035700 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:53:23.035783 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:53:23.035851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:53:23.346315 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:53:34.484232 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:53:34.484314 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:53:34.484375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:53:34.484442 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:53:34.484507 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:53:34.484575 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:53:34.484634 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:53:34.791216 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:53:51.812635 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:53:51.812740 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:53:51.812798 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:53:51.812861 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:53:51.812926 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:53:51.812988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:53:51.813047 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:53:52.122405 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:53:53.608413 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:53:53.608486 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:53:53.608558 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:53:53.608629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:53:53.608691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:53:53.608762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:53:53.608826 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:53:53.917242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:54:22.389913 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:54:22.390017 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:54:22.390100 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:54:22.390175 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:54:22.390255 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:54:22.390339 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:54:22.390421 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:54:22.693478 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:54:24.174442 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:54:24.174542 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:54:24.174622 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:54:24.174709 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:54:24.174789 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:54:24.174870 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:54:24.174947 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:54:24.479080 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:54:34.604636 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:54:34.604755 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:54:34.604877 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:54:34.604975 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:54:34.605070 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:54:34.605166 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:54:34.605270 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:54:34.920601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:54:52.950544 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:54:52.950642 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:54:52.950705 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:54:52.950790 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:54:52.950865 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:54:52.950941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:54:52.951018 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:54:53.255415 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:54:54.737155 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:54:54.737282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:54:54.737365 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:54:54.737474 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:54:54.737555 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:54:54.737695 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:54:54.737783 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:54:55.042971 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:55:23.518477 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:55:23.518574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:55:23.518644 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:55:23.518712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:55:23.518791 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:55:23.518860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:55:23.518927 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:55:23.823311 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:55:25.307183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:55:25.307303 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:55:25.307371 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:55:25.307446 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:55:25.307513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:55:25.307588 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:55:25.307665 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:55:25.614493 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:55:34.727037 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:55:34.727118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:55:34.727190 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:55:34.727254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:55:34.727323 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:55:34.727396 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:55:34.727460 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:55:35.043594 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:55:54.084764 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:55:54.084869 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:55:54.084936 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:55:54.084998 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:55:54.085072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:55:54.085138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:55:54.085201 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:55:54.396832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:55:55.877856 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:55:55.877950 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:55:55.878027 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:55:55.878094 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:55:55.878162 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:55:55.878225 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:55:55.878289 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:55:56.187522 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:56:24.660990 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:56:24.661091 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:56:24.661172 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:56:24.661249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:56:24.661325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:56:24.661404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:56:24.661492 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:56:24.961774 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:56:26.457459 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:56:26.457564 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:56:26.457638 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:56:26.457700 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:56:26.457775 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:56:26.457851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:56:26.457925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:56:26.767194 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:56:34.847922 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:56:34.848016 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:56:34.848083 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:56:34.848147 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:56:34.848213 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:56:34.848273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:56:34.848341 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:56:35.157856 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:56:55.241568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:56:55.241674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:56:55.241751 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:56:55.241817 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:56:55.241880 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:56:55.241943 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:56:55.242003 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:56:55.550318 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:56:57.027921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:56:57.028045 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:56:57.028128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:56:57.028206 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:56:57.028305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:56:57.028392 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:56:57.028473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:56:57.333295 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:57:25.810603 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:57:25.810700 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:57:25.810813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:57:25.810896 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:57:25.810973 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:57:25.811053 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:57:25.811133 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:57:26.115265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:57:27.590956 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:57:27.591051 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:57:27.591136 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:57:27.591214 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:57:27.591286 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:57:27.591365 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:57:27.591440 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:57:27.890083 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:57:34.969495 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:57:34.969590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:57:34.969669 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:57:34.969753 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:57:34.969830 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:57:34.969923 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:57:34.969996 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:57:35.276131 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:57:56.381262 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:57:56.381341 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:57:56.381410 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:57:56.381476 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:57:56.381539 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:57:56.381601 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:57:56.381659 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:57:56.694810 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:57:58.143592 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:57:58.143703 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:57:58.143804 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:57:58.143895 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:57:58.143971 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:57:58.144044 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:57:58.144115 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:57:58.443541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:58:26.956857 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:58:26.956973 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:58:26.957050 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:58:26.957117 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:58:26.957189 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:58:26.957269 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:58:26.957342 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:58:27.266061 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:58:28.701415 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:58:28.701519 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:58:28.701605 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:58:28.701689 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:58:28.701774 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:58:28.701845 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:58:28.701924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:58:29.014999 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:58:35.090566 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:58:35.090657 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:58:35.090743 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:58:35.090818 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:58:35.090891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:58:35.090964 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:58:35.091034 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:58:35.394869 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:58:57.534431 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:58:57.534523 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:58:57.534600 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:58:57.534668 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:58:57.534740 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:58:57.534806 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:58:57.534870 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:58:57.845670 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:58:59.290188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:58:59.290271 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:58:59.290336 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:58:59.290398 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:58:59.290458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:58:59.290527 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:58:59.290586 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:58:59.593421 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:59:28.108392 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:59:28.108483 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:59:28.108551 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:59:28.108616 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:59:28.108685 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:59:28.108758 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:59:28.108826 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:59:28.416133 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:59:29.849397 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:59:29.849504 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:59:29.849576 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:59:29.849632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:59:29.849700 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:59:29.849769 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:59:29.849837 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:59:30.167214 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:59:35.213148 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:59:35.213232 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:59:35.213310 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:59:35.213381 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:59:35.213438 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:59:35.213505 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:59:35.213565 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:59:35.516335 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 22:59:58.677791 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 22:59:58.677897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 22:59:58.677986 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 22:59:58.678058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 22:59:58.678127 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 22:59:58.678192 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 22:59:58.678304 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 22:59:58.995598 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:00:00.436576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:00:00.436659 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:00:00.436748 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:00:00.436810 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:00:00.436875 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:00:00.436936 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:00:00.437001 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:00:00.753771 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:00:29.264650 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:00:29.264749 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:00:29.264817 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:00:29.264879 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:00:29.264943 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:00:29.265009 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:00:29.265071 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:00:29.574605 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:00:31.014730 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:00:31.014810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:00:31.014873 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:00:31.014942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:00:31.015007 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:00:31.015065 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:00:31.015128 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:00:31.317785 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:00:35.333337 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:00:35.333407 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:00:35.333470 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:00:35.333530 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:00:35.333590 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:00:35.333650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:00:35.333706 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:00:35.644621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:00:59.834987 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:00:59.835068 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:00:59.835142 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:00:59.835205 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:00:59.835265 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:00:59.835324 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:00:59.835390 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:01:00.151778 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:01:01.582678 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:01:01.582779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:01:01.582847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:01:01.582921 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:01:01.582983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:01:01.583047 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:01:01.583106 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:01:01.884960 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:01:30.422193 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:01:30.422274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:01:30.422360 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:01:30.422419 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:01:30.422489 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:01:30.422550 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:01:30.422613 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:01:30.730155 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:01:32.154652 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:01:32.154754 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:01:32.154830 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:01:32.154899 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:01:32.154966 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:01:32.155032 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:01:32.155108 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:01:32.463211 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:01:35.456588 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:01:35.456664 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:01:35.457867 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:01:35.458102 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:01:35.458818 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:01:35.459090 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:01:35.459326 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:01:35.773967 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:02:00.989625 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:02:00.989716 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:02:00.989798 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:02:00.989868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:02:00.989952 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:02:00.990022 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:02:00.990097 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:02:01.289486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:02:02.721798 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:02:02.721912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:02:02.721983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:02:02.722042 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:02:02.722104 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:02:02.722171 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:02:02.722234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:02:03.027489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:02:31.555027 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:02:31.555142 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:02:31.555243 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:02:31.555340 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:02:31.555441 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:02:31.555532 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:02:31.555631 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:02:31.870538 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:02:33.298319 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:02:33.298431 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:02:33.298495 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:02:33.298553 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:02:33.298618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:02:33.298676 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:02:33.298750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:02:33.605716 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:02:35.578397 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:02:35.578476 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:02:35.578550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:02:35.578622 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:02:35.578693 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:02:35.578766 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:02:35.578837 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:02:35.880517 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:03:02.147128 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:03:02.147224 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:03:02.147298 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:03:02.147372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:03:02.147440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:03:02.147506 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:03:02.147574 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:03:02.450201 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:03:03.862792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:03:03.862897 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:03:03.862965 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:03:03.863025 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:03:03.863096 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:03:03.863157 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:03:03.863219 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:03:04.169625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:03:32.727618 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:03:32.727738 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:03:32.727826 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:03:32.727901 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:03:32.727986 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:03:32.728058 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:03:32.728141 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:03:33.032964 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:03:34.435287 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:03:34.435382 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:03:34.435452 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:03:34.435530 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:03:34.435597 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:03:34.435663 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:03:34.435742 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:03:34.735626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:03:35.701004 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:03:35.701100 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:03:35.701167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:03:35.701235 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:03:35.701295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:03:35.701353 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:03:35.701421 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:03:36.007731 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:04:03.301690 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:04:03.301783 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:04:03.301855 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:04:03.301913 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:04:03.301974 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:04:03.302037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:04:03.302101 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:04:03.607584 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:04:05.003060 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:04:05.004214 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:04:05.004903 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:04:05.005584 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:04:05.006099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:04:05.006691 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:04:05.006812 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:04:05.322019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:04:33.868308 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:04:33.868419 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:04:33.868491 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:04:33.868565 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:04:33.868646 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:04:33.868714 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:04:33.868797 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:04:34.172360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:04:35.592457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:04:35.592546 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:04:35.592609 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:04:35.592673 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:04:35.592745 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:04:35.592816 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:04:35.592886 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:04:35.902457 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:04:36.160628 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:04:36.160756 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:04:36.160833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:04:36.160906 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:04:36.160978 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:04:36.161053 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:04:36.161124 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:04:36.467244 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:05:04.432580 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:05:04.432684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:05:04.432781 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:05:04.432861 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:05:04.432964 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:05:04.433047 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:05:04.433134 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:05:04.738358 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:05:06.161636 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:05:06.161745 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:05:06.161817 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:05:06.161889 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:05:06.161961 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:05:06.162060 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:05:06.162138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:05:06.473395 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:05:35.000879 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:05:35.000982 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:05:35.001053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:05:35.001127 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:05:35.001198 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:05:35.001270 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:05:35.001335 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:05:35.303308 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:05:35.942125 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:05:35.942211 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:05:35.942281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:05:35.942348 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:05:35.942411 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:05:35.942474 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:05:35.942542 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:05:36.248283 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:05:36.744861 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:05:36.744975 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:05:36.745056 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:05:36.745136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:05:36.745222 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:05:36.745295 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:05:36.745373 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:05:37.059115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:06:05.561503 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:06:05.561616 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:06:05.561689 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:06:05.561769 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:06:05.561848 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:06:05.561925 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:06:05.561996 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:06:05.868106 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:06:07.329524 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:06:07.329612 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:06:07.329685 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:06:07.329758 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:06:07.329827 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:06:07.329894 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:06:07.329957 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:06:07.633777 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:06:36.069445 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:06:36.069524 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:06:36.069587 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:06:36.069656 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:06:36.069721 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:06:36.069782 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:06:36.069841 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:06:36.371242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:06:36.637019 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:06:36.637096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:06:36.637164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:06:36.637225 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:06:36.637293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:06:36.637355 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:06:36.637420 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:06:36.942866 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:06:37.900667 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:06:37.900771 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:06:37.900841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:06:37.900905 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:06:37.900973 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:06:37.901034 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:06:37.901100 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:06:38.199932 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:07:06.638712 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:07:06.638806 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:07:06.638881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:07:06.638950 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:07:06.639015 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:07:06.639079 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:07:06.639134 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:07:06.945994 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:07:08.459703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:07:08.459801 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:07:08.459877 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:07:08.459934 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:07:08.459999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:07:08.460057 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:07:08.460128 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:07:08.766412 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:07:36.201812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:07:36.201890 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:07:36.201958 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:07:36.202020 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:07:36.202082 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:07:36.202144 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:07:36.202205 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:07:36.511536 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:07:37.205202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:07:37.205286 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:07:37.205350 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:07:37.205417 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:07:37.205485 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:07:37.205554 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:07:37.205616 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:07:37.509947 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:07:39.028312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:07:39.028409 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:07:39.028489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:07:39.028568 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:07:39.028644 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:07:39.028724 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:07:39.028806 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:07:39.344121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:08:07.772174 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:08:07.772272 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:08:07.772352 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:08:07.772430 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:08:07.772537 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:08:07.772615 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:08:07.772698 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:08:08.075986 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:08:09.603884 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:08:09.604001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:08:09.604090 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:08:09.604168 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:08:09.604244 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:08:09.604320 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:08:09.604393 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:08:09.911962 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:08:36.324930 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:08:36.325042 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:08:36.325146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:08:36.325229 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:08:36.325301 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:08:36.325384 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:08:36.325459 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:08:36.633406 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:08:38.337693 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:08:38.337802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:08:38.337906 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:08:38.338006 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:08:38.338094 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:08:38.338177 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:08:38.338258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:08:38.642575 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:08:40.177995 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:08:40.178094 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:08:40.178165 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:08:40.178245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:08:40.178319 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:08:40.178392 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:08:40.178462 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:08:40.486773 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:09:08.896390 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:09:08.896482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:09:08.896548 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:09:08.896622 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:09:08.896685 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:09:08.896761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:09:08.896845 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:09:09.229330 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:09:10.747667 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:09:10.747784 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:09:10.747865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:09:10.747934 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:09:10.748003 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:09:10.748070 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:09:10.748133 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:09:11.057566 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:09:36.452196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:09:36.452275 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:09:36.452343 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:09:36.452415 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:09:36.452477 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:09:36.452536 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:09:36.452597 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:09:36.761933 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:09:39.488656 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:09:39.488747 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:09:39.488810 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:09:39.488883 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:09:39.488947 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:09:39.489009 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:09:39.489075 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:09:39.795885 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:09:41.318589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:09:41.319455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:09:41.319932 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:09:41.320443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:09:41.321251 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:09:41.321765 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:09:41.321844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:09:41.628033 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:10:10.050304 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:10:10.050394 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:10:10.050464 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:10:10.050537 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:10:10.050602 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:10:10.050665 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:10:10.050730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:10:10.374918 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:10:11.890604 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:10:11.890691 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:10:11.890768 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:10:11.890838 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:10:11.890910 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:10:11.890979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:10:11.891047 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:10:12.217689 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:10:36.574586 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:10:36.574672 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:10:36.574738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:10:36.574803 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:10:36.574866 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:10:36.574934 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:10:36.574997 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:10:36.877259 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:10:40.639574 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:10:40.639655 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:10:40.639733 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:10:40.639835 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:10:40.639900 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:10:40.639969 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:10:40.640032 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:10:40.946459 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:10:42.481588 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:10:42.481679 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:10:42.481762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:10:42.481829 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:10:42.481888 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:10:42.481951 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:10:42.482006 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:10:42.789409 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:11:11.207001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:11:11.207089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:11:11.207153 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:11:11.207228 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:11:11.207297 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:11:11.207360 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:11:11.207429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:11:11.511574 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:11:13.048736 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:11:13.048836 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:11:13.048899 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:11:13.048961 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:11:13.049021 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:11:13.049084 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:11:13.049148 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:11:13.358109 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:11:36.698290 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:11:36.698378 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:11:36.698442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:11:36.698512 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:11:36.698572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:11:36.698633 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:11:36.698693 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:11:37.004316 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:11:41.774798 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:11:41.774892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:11:41.774957 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:11:41.775021 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:11:41.775079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:11:41.775144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:11:41.775210 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:11:42.094641 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:11:43.618558 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:11:43.618655 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:11:43.618756 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:11:43.618815 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:11:43.618882 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:11:43.618952 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:11:43.619008 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:11:43.935712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:12:12.365577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:12:12.365664 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:12:12.365748 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:12:12.365809 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:12:12.365872 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:12:12.365931 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:12:12.365995 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:12:12.670763 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:12:14.195633 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:12:14.195727 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:12:14.195798 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:12:14.195867 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:12:14.195955 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:12:14.196022 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:12:14.196089 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:12:14.502003 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:12:36.820247 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:12:36.820334 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:12:36.820395 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:12:36.820460 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:12:36.820523 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:12:36.820580 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:12:36.820649 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:12:37.130186 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:12:42.928490 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:12:42.928602 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:12:42.928673 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:12:42.928752 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:12:42.928825 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:12:42.928903 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:12:42.928968 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:12:43.231809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:12:44.763982 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:12:44.764070 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:12:44.764159 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:12:44.764237 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:12:44.764311 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:12:44.764392 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:12:44.764471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:12:45.065419 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:13:13.489339 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:13:13.489420 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:13:13.489493 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:13:13.489568 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:13:13.489635 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:13:13.489702 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:13:13.489796 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:13:13.794238 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:13:15.323774 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:13:15.323865 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:13:15.323954 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:13:15.324035 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:13:15.324141 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:13:15.324219 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:13:15.324297 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:13:15.622215 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:13:36.940500 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:13:36.940587 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:13:36.940667 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:13:36.940744 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:13:36.940823 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:13:36.940895 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:13:36.940967 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:13:37.250209 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:13:44.064300 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:13:44.064392 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:13:44.064468 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:13:44.064531 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:13:44.064594 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:13:44.064658 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:13:44.064738 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:13:44.366206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:13:45.873623 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:13:45.873740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:13:45.873806 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:13:45.873872 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:13:45.873936 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:13:45.873998 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:13:45.874058 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:13:46.176959 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:14:14.634207 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:14:14.634306 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:14:14.634380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:14:14.634448 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:14:14.634518 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:14:14.634576 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:14:14.634635 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:14:14.936739 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:14:16.433180 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:14:16.433264 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:14:16.433337 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:14:16.433401 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:14:16.433465 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:14:16.433529 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:14:16.433595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:14:16.736561 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:14:37.063853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:14:37.063948 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:14:37.064031 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:14:37.064113 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:14:37.064194 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:14:37.064272 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:14:37.064355 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:14:37.375714 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:14:45.196775 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:14:45.196881 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:14:45.196945 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:14:45.197023 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:14:45.197093 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:14:45.197163 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:14:45.197233 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:14:45.500244 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:14:47.000060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:14:47.000157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:14:47.000235 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:14:47.000323 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:14:47.000404 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:14:47.000471 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:14:47.000549 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:14:47.298142 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:15:15.761753 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:15:15.761850 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:15:15.761921 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:15:15.761991 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:15:15.762062 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:15:15.762144 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:15:15.762201 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:15:16.064635 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:15:17.557101 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:15:17.557181 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:15:17.557248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:15:17.557313 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:15:17.557375 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:15:17.557434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:15:17.558531 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:15:17.879765 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:15:37.188976 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:15:37.189062 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:15:37.189138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:15:37.189202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:15:37.189269 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:15:37.189333 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:15:37.189402 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:15:37.495758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:15:46.329646 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:15:46.329750 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:15:46.329812 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:15:46.329882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:15:46.329947 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:15:46.330014 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:15:46.330078 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:15:46.645864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:15:48.143385 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:15:48.143482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:15:48.143558 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:15:48.143630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:15:48.143691 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:15:48.143759 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:15:48.143826 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:15:48.453904 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:16:16.909670 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:16:16.909769 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:16:16.909845 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:16:16.909910 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:16:16.909975 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:16:16.910034 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:16:16.910096 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:16:17.217044 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:16:18.721679 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:16:18.721772 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:16:18.721851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:16:18.721916 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:16:18.721983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:16:18.722048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:16:18.722114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:16:19.027897 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:16:37.314490 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:16:37.314672 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:16:37.314771 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:16:37.314890 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:16:37.314968 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:16:37.315076 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:16:37.315165 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:16:37.620137 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:16:47.483823 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:16:47.483907 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:16:47.483987 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:16:47.484057 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:16:47.484136 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:16:47.484201 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:16:47.484270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:16:47.801144 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:16:49.300763 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:16:49.300840 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:16:49.300917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:16:49.300978 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:16:49.301071 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:16:49.301173 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:16:49.301266 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:16:49.608591 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:17:18.057999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:17:18.058083 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:17:18.058148 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:17:18.058213 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:17:18.058283 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:17:18.058343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:17:18.058402 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:17:18.365476 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:17:19.872891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:17:19.872973 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:17:19.873059 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:17:19.873119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:17:19.873184 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:17:19.873245 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:17:19.873307 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:17:20.180127 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:17:37.435647 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:17:37.435733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:17:37.435803 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:17:37.435863 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:17:37.435932 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:17:37.435991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:17:37.436064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:17:37.738018 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:17:48.628540 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:17:48.628632 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:17:48.628707 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:17:48.628819 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:17:48.628884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:17:48.628948 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:17:48.629005 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:17:48.938711 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:17:50.440383 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:17:50.440468 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:17:50.440547 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:17:50.440608 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:17:50.440668 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:17:50.440734 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:17:50.440795 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:17:50.746725 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:18:19.200834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:18:19.200915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:18:19.200988 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:18:19.201052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:18:19.201112 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:18:19.201176 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:18:19.201238 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:18:19.516638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:18:21.004345 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:18:21.004447 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:18:21.004506 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:18:21.004569 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:18:21.004631 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:18:21.004690 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:18:21.004763 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:18:21.317413 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:18:37.555087 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:18:37.555162 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:18:37.555221 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:18:37.555303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:18:37.555360 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:18:37.555422 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:18:37.555483 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:18:37.860265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:18:49.775629 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:18:49.775725 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:18:49.775788 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:18:49.775851 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:18:49.775911 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:18:49.775968 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:18:49.776054 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:18:50.090862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:18:51.576674 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:18:51.577502 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:18:51.577690 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:18:51.577857 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:18:51.578388 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:18:51.578799 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:18:51.579392 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:18:51.887804 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:19:20.353612 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:19:20.353694 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:19:20.353775 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:19:20.353841 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:19:20.353904 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:19:20.353967 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:19:20.354030 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:19:20.659002 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:19:22.158836 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:19:22.158914 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:19:22.158981 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:19:22.159045 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:19:22.159109 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:19:22.159170 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:19:22.159232 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:19:22.464881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:19:37.675340 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:19:37.675415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:19:37.675479 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:19:37.675555 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:19:37.675610 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:19:37.675671 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:19:37.675741 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:19:37.980324 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:19:50.921632 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:19:50.921729 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:19:50.921792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:19:50.921860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:19:50.921921 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:19:50.921980 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:19:50.922041 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:19:51.233426 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:19:52.720668 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:19:52.720761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:19:52.720824 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:19:52.720892 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:19:52.720954 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:19:52.721012 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:19:52.721074 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:19:53.026440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:20:21.497213 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:20:21.497298 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:20:21.497370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:20:21.497435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:20:21.497501 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:20:21.497560 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:20:21.497620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:20:21.811618 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:20:23.289598 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:20:23.289706 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:20:23.289781 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:20:23.289844 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:20:23.289909 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:20:23.289973 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:20:23.290036 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:20:23.598583 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:20:37.798199 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:20:37.798286 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:20:37.798350 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:20:37.798413 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:20:37.798475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:20:37.798549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:20:37.798609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:20:38.112976 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:20:52.084049 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:20:52.084200 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:20:52.084309 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:20:52.084410 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:20:52.084509 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:20:52.084613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:20:52.084737 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:20:52.405050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:20:53.859701 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:20:53.859823 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:20:53.859902 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:20:53.859974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:20:53.860049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:20:53.860124 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:20:53.860210 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:20:54.165806 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:21:22.669801 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:21:22.670170 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:21:22.670407 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:21:22.670862 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:21:22.671730 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:21:22.671842 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:21:22.671928 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:21:22.973064 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:21:24.428915 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:21:24.429021 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:21:24.429085 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:21:24.429151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:21:24.429210 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:21:24.429281 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:21:24.429343 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:21:24.730712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:21:37.924319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:21:37.924401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:21:37.924464 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:21:37.924530 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:21:37.924589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:21:37.924654 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:21:37.924721 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:21:38.223264 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:21:53.231983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:21:53.232064 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:21:53.232129 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:21:53.232191 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:21:53.232253 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:21:53.232316 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:21:53.232382 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:21:53.540790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:21:54.990801 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:21:54.990887 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:21:54.990949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:21:54.991027 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:21:54.991109 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:21:54.991173 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:21:54.991233 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:21:55.314814 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:22:23.800998 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:22:23.801099 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:22:23.801168 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:22:23.801241 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:22:23.801307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:22:23.801366 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:22:23.801432 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:22:24.106922 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:22:25.583661 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:22:25.583743 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:22:25.583809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:22:25.583871 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:22:25.583929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:22:25.583997 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:22:25.584058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:22:25.890655 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:22:38.047986 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:22:38.048078 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:22:38.048143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:22:38.048207 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:22:38.048274 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:22:38.048333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:22:38.048394 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:22:38.357112 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:22:54.366975 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:22:54.367085 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:22:54.367150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:22:54.367215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:22:54.367279 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:22:54.367339 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:22:54.367401 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:22:54.675188 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:22:56.148392 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:22:56.148488 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:22:56.148548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:22:56.148608 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:22:56.148670 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:22:56.148751 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:22:56.148809 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:22:56.458185 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:23:24.938875 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:23:24.938981 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:23:24.939062 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:23:24.939143 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:23:24.939226 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:23:24.939310 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:23:24.939391 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:23:25.269040 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:23:26.715893 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:23:26.715988 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:23:26.716082 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:23:26.716159 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:23:26.716234 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:23:26.716314 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:23:26.716383 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:23:27.030177 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:23:38.174486 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:23:38.174584 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:23:38.174681 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:23:38.174774 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:23:38.174890 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:23:38.174978 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:23:38.175070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:23:38.477381 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:23:55.532437 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:23:55.532542 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:23:55.532630 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:23:55.532703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:23:55.532789 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:23:55.532867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:23:55.532947 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:23:55.841326 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:23:57.294019 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:23:57.294109 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:23:57.294183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:23:57.294259 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:23:57.294323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:23:57.294393 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:23:57.294467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:23:57.597360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:24:26.098671 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:24:26.098772 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:24:26.098847 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:24:26.098911 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:24:26.098976 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:24:26.099031 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:24:26.099101 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:24:26.401936 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:24:27.865374 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:24:27.865460 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:24:27.865531 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:24:27.865593 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:24:27.865653 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:24:27.865725 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:24:27.865787 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:24:28.174111 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:24:38.294976 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:24:38.295058 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:24:38.295129 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:24:38.295192 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:24:38.295258 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:24:38.295320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:24:38.295384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:24:38.609149 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:24:56.664955 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:24:56.665117 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:24:56.665519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:24:56.666545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:24:56.666659 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:24:56.666757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:24:56.666835 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:24:56.971906 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:24:58.445292 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:24:58.445390 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:24:58.445462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:24:58.445526 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:24:58.445598 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:24:58.445663 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:24:58.445733 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:24:58.748923 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:25:27.227767 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:25:27.227848 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:25:27.227916 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:25:27.227980 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:25:27.228041 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:25:27.228098 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:25:27.228162 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:25:27.531559 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:25:29.017289 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:25:29.017383 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:25:29.017464 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:25:29.017539 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:25:29.017618 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:25:29.017692 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:25:29.017798 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:25:29.324121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:25:38.421577 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:25:38.421670 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:25:38.421753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:25:38.421850 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:25:38.421921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:25:38.422008 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:25:38.422085 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:25:38.721680 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:25:57.791783 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:25:57.791900 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:25:57.791972 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:25:57.792054 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:25:57.792143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:25:57.792212 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:25:57.792286 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:25:58.094809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:25:59.584112 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:25:59.584530 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:25:59.585435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:25:59.585564 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:25:59.585650 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:25:59.585731 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:25:59.585814 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:25:59.892674 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:26:28.356343 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:26:28.356426 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:26:28.356509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:26:28.356572 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:26:28.356639 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:26:28.356707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:26:28.356799 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:26:28.658179 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:26:30.155692 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:26:30.155778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:26:30.155864 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:26:30.155927 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:26:30.155993 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:26:30.156056 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:26:30.156119 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:26:30.457449 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:26:38.543801 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:26:38.543879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:26:38.543953 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:26:38.544012 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:26:38.544078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:26:38.544153 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:26:38.544216 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:26:38.843934 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:26:58.919939 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:26:58.920025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:26:58.920089 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:26:58.920153 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:26:58.920215 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:26:58.920276 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:26:58.920333 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:26:59.232062 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:27:00.715777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:27:00.715863 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:27:00.715929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:27:00.715991 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:27:00.716059 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:27:00.716122 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:27:00.716185 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:27:01.020060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:27:29.495982 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:27:29.496065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:27:29.496136 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:27:29.496203 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:27:29.496269 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:27:29.496335 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:27:29.496402 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:27:29.812712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:27:31.283516 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:27:31.283604 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:27:31.283669 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:27:31.283744 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:27:31.283805 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:27:31.283877 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:27:31.283937 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:27:31.591653 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:27:38.665703 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:27:38.665787 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:27:38.665851 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:27:38.665914 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:27:38.665984 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:27:38.666041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:27:38.666106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:27:38.971663 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:28:00.091520 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:28:00.091610 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:28:00.091681 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:28:00.091769 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:28:00.091838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:28:00.091905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:28:00.091966 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:28:00.401104 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:28:01.856425 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:28:01.856533 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:28:01.856632 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:28:01.856709 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:28:01.856796 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:28:01.856870 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:28:01.856958 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:28:02.167759 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:28:30.664586 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:28:30.664676 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:28:30.664749 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:28:30.664820 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:28:30.664886 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:28:30.664950 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:28:30.665007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:28:30.969634 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:28:32.435177 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:28:32.435264 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:28:32.435332 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:28:32.435396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:28:32.435458 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:28:32.435523 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:28:32.435583 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:28:32.737925 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:28:38.783190 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:28:38.783270 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:28:38.783336 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:28:38.783396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:28:38.783462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:28:38.783523 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:28:38.783594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:28:39.092118 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:29:01.230756 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:29:01.230840 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:29:01.230924 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:29:01.230983 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:29:01.231053 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:29:01.231110 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:29:01.231173 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:29:01.537667 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:29:02.996115 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:29:02.996202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:29:02.996281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:29:02.996347 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:29:02.996408 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:29:02.996482 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:29:02.996540 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:29:03.300801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:29:31.809661 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:29:31.809750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:29:31.809827 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:29:31.809893 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:29:31.809954 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:29:31.810019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:29:31.810089 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:29:32.122649 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:29:33.565560 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:29:33.565670 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:29:33.565760 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:29:33.565842 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:29:33.565935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:29:33.566064 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:29:33.566146 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:29:33.870461 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:29:38.903458 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:29:38.903543 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:29:38.903611 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:29:38.903693 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:29:38.903785 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:29:38.903856 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:29:38.903921 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:29:39.225408 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:30:02.386401 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:30:02.386479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:30:02.386549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:30:02.386604 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:30:02.386668 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:30:02.386736 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:30:02.386803 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:30:02.703422 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:30:04.136469 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:30:04.136562 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:30:04.136643 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:30:04.136706 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:30:04.136773 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:30:04.136834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:30:04.136900 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:30:04.459262 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:30:32.974540 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:30:32.974625 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:30:32.974695 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:30:32.974770 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:30:32.974838 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:30:32.974894 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:30:32.974959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:30:33.281174 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:30:34.725464 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:30:34.725558 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:30:34.725633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:30:34.725696 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:30:34.725783 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:30:34.725853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:30:34.725913 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:30:35.041481 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:30:39.028084 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:30:39.028217 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:30:39.028305 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:30:39.028381 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:30:39.028465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:30:39.028546 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:30:39.028632 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:30:39.333790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:31:03.547125 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:31:03.547218 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:31:03.547282 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:31:03.547350 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:31:03.547418 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:31:03.547480 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:31:03.547557 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:31:03.850326 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:31:05.313811 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:31:05.313915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:31:05.313999 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:31:05.314074 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:31:05.314174 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:31:05.314251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:31:05.314324 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:31:05.622737 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:31:34.114462 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:31:34.114574 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:31:34.114649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:31:34.114751 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:31:34.114831 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:31:34.114915 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:31:34.114994 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:31:34.431410 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:31:35.883951 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:31:35.884067 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:31:35.884160 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:31:35.884237 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:31:35.884309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:31:35.884391 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:31:35.884459 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:31:36.183611 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:31:39.146628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:31:39.146712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:31:39.146791 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:31:39.146877 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:31:39.146949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:31:39.147016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:31:39.147090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:31:39.460667 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:32:04.690753 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:32:04.690840 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:32:04.690912 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:32:04.690988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:32:04.691051 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:32:04.691121 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:32:04.691187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:32:05.007212 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:32:06.437268 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:32:06.437345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:32:06.437409 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:32:06.437473 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:32:06.437538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:32:06.437631 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:32:06.437695 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:32:06.737982 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:32:35.269056 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:32:35.269147 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:32:35.269218 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:32:35.269281 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:32:35.269344 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:32:35.269406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:32:35.269471 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:32:35.578483 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:32:37.005393 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:32:37.005474 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:32:37.005544 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:32:37.005625 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:32:37.005689 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:32:37.005762 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:32:37.005832 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:32:37.316467 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:32:39.266979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:32:39.267063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:32:39.267134 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:32:39.267207 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:32:39.267262 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:32:39.267335 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:32:39.267398 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:32:39.576231 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:33:05.839473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:33:05.839562 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:33:05.839632 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:33:05.839704 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:33:05.839777 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:33:05.839844 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:33:05.839909 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:33:06.145992 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:33:07.573146 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:33:07.573231 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:33:07.573291 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:33:07.573356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:33:07.573418 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:33:07.573479 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:33:07.573539 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:33:07.879562 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:33:36.410465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:33:36.410573 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:33:36.410650 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:33:36.410736 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:33:36.410815 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:33:36.410895 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:33:36.410963 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:33:36.713981 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:33:38.136353 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:33:38.136447 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:33:38.136520 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:33:38.136590 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:33:38.136664 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:33:38.136735 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:33:38.136799 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:33:38.438537 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:33:39.388781 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:33:39.388863 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:33:39.388929 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:33:39.388993 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:33:39.389060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:33:39.389121 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:33:39.389181 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:33:39.706205 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:34:06.976608 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:34:06.976708 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:34:06.976799 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:34:06.976871 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:34:06.976950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:34:06.977022 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:34:06.977099 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:34:07.281290 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:34:08.699168 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:34:08.699274 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:34:08.699345 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:34:08.699415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:34:08.699488 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:34:08.699561 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:34:08.699635 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:34:09.001042 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:34:37.543994 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:34:37.544087 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:34:37.544161 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:34:37.544228 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:34:37.544297 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:34:37.544368 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:34:37.544432 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:34:37.854125 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:34:39.265047 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:34:39.265124 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:34:39.265191 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:34:39.265256 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:34:39.265321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:34:39.265380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:34:39.265448 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:34:39.582824 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:34:39.847966 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:34:39.848052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:34:39.848131 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:34:39.848198 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:34:39.848269 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:34:39.848335 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:34:39.848408 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:34:40.158138 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:35:08.114456 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:35:08.114544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:35:08.114612 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:35:08.114682 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:35:08.114745 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:35:08.114808 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:35:08.114873 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:35:08.423270 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:35:09.849115 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:35:09.849216 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:35:09.849284 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:35:09.849344 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:35:09.849406 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:35:09.849467 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:35:09.849524 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:35:10.154180 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:35:38.689550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:35:38.689639 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:35:38.689714 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:35:38.689799 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:35:38.689861 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:35:38.689926 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:35:38.689984 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:35:38.993007 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:35:39.622906 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:35:39.622994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:35:39.623069 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:35:39.623140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:35:39.623215 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:35:39.623283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:35:39.623355 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:35:39.932002 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:35:40.411191 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:35:40.411273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:35:40.411334 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:35:40.411417 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:35:40.411477 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:35:40.411540 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:35:40.411602 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:35:40.715409 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:36:09.254466 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:36:09.254552 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:36:09.254618 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:36:09.254694 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:36:09.254769 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:36:09.254840 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:36:09.254908 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:36:09.565261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:36:10.974386 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:36:10.974480 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:36:10.974571 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:36:10.974638 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:36:10.974701 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:36:10.974788 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:36:10.974870 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:36:11.283841 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:36:39.745566 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:36:39.745646 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:36:39.745714 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:36:39.745784 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:36:39.745847 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:36:39.745905 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:36:39.745976 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:36:40.053230 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:36:40.318977 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:36:40.319069 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:36:40.319135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:36:40.319208 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:36:40.319272 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:36:40.319338 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:36:40.319401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:36:40.618115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:36:41.550434 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:36:41.550524 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:36:41.550593 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:36:41.550658 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:36:41.550726 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:36:41.550802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:36:41.550862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:36:41.869862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:37:10.319836 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:37:10.319917 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:37:10.319985 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:37:10.320058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:37:10.320117 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:37:10.320180 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:37:10.320238 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:37:10.621609 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:37:12.144257 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:37:12.144345 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:37:12.144407 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:37:12.144484 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:37:12.144544 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:37:12.144612 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:37:12.144674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:37:12.456144 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:37:39.873194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:37:39.873279 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:37:39.873350 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:37:39.873416 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:37:39.873486 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:37:39.873551 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:37:39.873617 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:37:40.187427 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:37:40.883070 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:37:40.883168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:37:40.883236 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:37:40.883298 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:37:40.883360 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:37:40.883422 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:37:40.883487 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:37:41.195997 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:37:42.714162 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:37:42.714247 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:37:42.714315 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:37:42.714376 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:37:42.714436 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:37:42.714504 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:37:42.714564 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:37:43.024873 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:38:11.468080 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:38:11.468188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:38:11.468263 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:38:11.468345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:38:11.468425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:38:11.468498 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:38:11.468596 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:38:11.774482 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:38:13.289653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:38:13.289776 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:38:13.289868 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:38:13.289937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:38:13.290013 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:38:13.290084 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:38:13.290158 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:38:13.593225 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:38:40.008893 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:38:40.008995 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:38:40.009084 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:38:40.009159 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:38:40.009232 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:38:40.009307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:38:40.009385 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:38:40.320133 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:38:42.037757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:38:42.037847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:38:42.037916 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:38:42.037983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:38:42.038055 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:38:42.038126 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:38:42.038193 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:38:42.351653 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:38:43.849658 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:38:43.849765 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:38:43.849831 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:38:43.849895 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:38:43.849956 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:38:43.850025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:38:43.850087 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:38:44.158474 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:39:12.613006 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:39:12.613089 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:39:12.613157 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:39:12.613227 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:39:12.613294 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:39:12.613350 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:39:12.613410 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:39:12.917356 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:39:14.423374 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:39:14.423461 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:39:14.423534 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:39:14.423598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:39:14.423663 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:39:14.423733 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:39:14.423796 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:39:14.730950 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:39:40.132440 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:39:40.132529 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:39:40.132598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:39:40.132663 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:39:40.132737 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:39:40.132804 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:39:40.132870 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:39:40.437375 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:39:43.178774 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:39:43.178867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:39:43.178936 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:39:43.179000 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:39:43.179058 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:39:43.179121 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:39:43.179218 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:39:43.483481 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:39:44.987966 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:39:44.988060 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:39:44.988141 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:39:44.988226 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:39:44.988307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:39:44.988379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:39:44.988455 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:39:45.289832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:40:13.747713 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:40:13.747825 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:40:13.747905 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:40:13.747978 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:40:13.748044 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:40:13.748117 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:40:13.748186 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:40:14.058487 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:40:15.547938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:40:15.548052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:40:15.548132 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:40:15.548210 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:40:15.548288 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:40:15.548362 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:40:15.548453 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:40:15.850981 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:40:40.263803 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:40:40.263897 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:40:40.263967 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:40:40.264038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:40:40.264110 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:40:40.264180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:40:40.264251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:40:40.567674 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:40:44.326452 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:40:44.326531 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:40:44.326600 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:40:44.326665 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:40:44.326746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:40:44.326810 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:40:44.326873 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:40:44.638304 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:40:46.110675 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:40:46.111955 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:40:46.112160 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:40:46.112733 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:40:46.113189 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:40:46.113583 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:40:46.114230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:40:46.419424 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:41:14.900453 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:41:14.900546 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:41:14.900609 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:41:14.900690 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:41:14.900772 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:41:14.900839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:41:14.900912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:41:15.207439 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:41:16.678258 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:41:16.678352 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:41:16.678427 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:41:16.678504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:41:16.678585 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:41:16.678662 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:41:16.678746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:41:16.989613 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:41:40.394060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:41:40.394146 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:41:40.394232 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:41:40.394309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:41:40.394387 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:41:40.394459 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:41:40.394537 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:41:40.697946 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:41:45.480859 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:41:45.480978 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:41:45.481059 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:41:45.481145 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:41:45.481230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:41:45.481318 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:41:45.481392 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:41:45.782364 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:41:47.255985 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:41:47.256083 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:41:47.256161 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:41:47.256241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:41:47.256321 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:41:47.256394 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:41:47.256475 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:41:47.555210 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:42:16.036483 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:42:16.037613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:42:16.037824 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:42:16.038307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:42:16.039028 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:42:16.039838 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:42:16.039943 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:42:16.343046 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:42:17.824232 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:42:17.824327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:42:17.824398 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:42:17.824462 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:42:17.824531 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:42:17.824596 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:42:17.824661 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:42:18.129239 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:42:40.520296 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:42:40.520392 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:42:40.520466 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:42:40.520543 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:42:40.520621 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:42:40.520700 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:42:40.520785 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:42:40.827290 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:42:46.605063 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:42:46.605159 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:42:46.605241 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:42:46.605321 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:42:46.605391 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:42:46.605463 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:42:46.605539 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:42:46.913763 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:42:48.395756 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:42:48.395870 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:42:48.395940 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:42:48.396022 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:42:48.396099 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:42:48.396173 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:42:48.396246 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:42:48.699639 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:43:17.175262 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:43:17.175369 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:43:17.175435 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:43:17.175503 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:43:17.175563 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:43:17.175626 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:43:17.175689 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:43:17.482301 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:43:18.959842 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:43:18.959932 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:43:18.960003 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:43:18.960067 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:43:18.960163 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:43:18.960233 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:43:18.960330 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:43:19.266410 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:43:40.647221 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:43:40.647298 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:43:40.647382 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:43:40.647447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:43:40.647513 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:43:40.647571 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:43:40.647637 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:43:40.953846 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:43:47.747575 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:43:47.747660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:43:47.747732 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:43:47.747803 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:43:47.747862 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:43:47.747935 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:43:47.747999 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:43:48.050892 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:43:49.528251 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:43:49.528339 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:43:49.528408 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:43:49.528478 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:43:49.528538 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:43:49.528596 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:43:49.528661 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:43:49.829490 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:44:18.314822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:44:18.314919 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:44:18.314990 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:44:18.315056 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:44:18.315121 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:44:18.315183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:44:18.315252 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:44:18.619868 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:44:20.104704 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:44:20.104800 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:44:20.104862 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:44:20.104931 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:44:20.105002 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:44:20.105066 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:44:20.105131 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:44:20.411697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:44:40.771119 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:44:40.771228 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:44:40.771310 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:44:40.771384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:44:40.771459 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:44:40.771531 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:44:40.771605 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:44:41.079041 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:44:48.876733 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:44:48.876837 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:44:48.876906 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:44:48.876978 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:44:48.877048 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:44:48.877116 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:44:48.877188 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:44:49.184732 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:44:50.676211 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:44:50.676309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:44:50.676384 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:44:50.676450 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:44:50.676527 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:44:50.676593 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:44:50.676660 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:44:50.972871 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:45:19.446059 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:45:19.446169 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:45:19.446235 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:45:19.446296 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:45:19.446364 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:45:19.446425 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:45:19.446494 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:45:19.755745 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:45:21.233656 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:45:21.233790 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:45:21.233853 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:45:21.233925 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:45:21.233999 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:45:21.234071 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:45:21.234145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:45:21.532333 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:45:40.898741 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:45:40.898838 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:45:40.899738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:45:40.900424 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:45:40.900758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:45:40.901620 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:45:40.901734 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:45:41.208223 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:45:50.019042 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:45:50.019163 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:45:50.019242 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:45:50.019319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:45:50.019387 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:45:50.019464 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:45:50.019547 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:45:50.330075 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:45:51.787127 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:45:51.787224 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:45:51.787303 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:45:51.787362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:45:51.787429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:45:51.787495 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:45:51.787560 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:45:52.098428 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:46:20.590648 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:46:20.590796 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:46:20.590906 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:46:20.591039 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:46:20.591151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:46:20.591280 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:46:20.591383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:46:20.892246 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:46:22.360380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:46:22.360493 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:46:22.360560 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:46:22.360660 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:46:22.360743 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:46:22.360835 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:46:22.360917 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:46:22.667873 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:46:41.025871 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:46:41.025965 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:46:41.026037 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:46:41.026113 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:46:41.026199 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:46:41.026266 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:46:41.026344 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:46:41.332460 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:46:51.150794 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:46:51.150919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:46:51.150998 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:46:51.151099 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:46:51.151172 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:46:51.152764 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:46:51.153277 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:46:51.474826 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:46:52.926563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:46:52.926681 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:46:52.926773 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:46:52.926843 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:46:52.926931 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:46:52.926993 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:46:52.927062 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:46:53.239042 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:47:21.732049 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:47:21.732145 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:47:21.732223 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:47:21.732294 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:47:21.732365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:47:21.732433 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:47:21.732495 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:47:22.037580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:47:23.507502 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:47:23.507593 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:47:23.507664 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:47:23.507739 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:47:23.507798 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:47:23.507870 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:47:23.507941 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:47:23.826032 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:47:41.152417 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:47:41.152502 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:47:41.152567 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:47:41.152633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:47:41.152710 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:47:41.152775 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:47:41.152850 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:47:41.467491 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:47:52.315389 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:47:52.315509 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:47:52.315587 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:47:52.315671 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:47:52.315744 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:47:52.315820 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:47:52.315883 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:47:52.619204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:47:54.101144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:47:54.101256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:47:54.101332 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:47:54.101409 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:47:54.101478 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:47:54.101542 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:47:54.101616 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:47:54.418715 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:48:22.883898 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:48:22.883980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:48:22.884047 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:48:22.884114 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:48:22.884173 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:48:22.884237 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:48:22.884299 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:48:23.188596 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:48:24.683921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:48:24.684029 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:48:24.684093 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:48:24.684159 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:48:24.684219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:48:24.684284 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:48:24.684342 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:48:24.985635 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:48:41.280928 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:48:41.281007 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:48:41.281076 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:48:41.281139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:48:41.281200 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:48:41.281262 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:48:41.281330 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:48:41.593100 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:48:53.452053 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:48:53.452156 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:48:53.452226 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:48:53.452308 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:48:53.452387 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:48:53.452449 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:48:53.452514 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:48:53.762030 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:48:55.257512 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:48:55.257613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:48:55.257686 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:48:55.257760 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:48:55.257815 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:48:55.257888 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:48:55.257952 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:48:55.564101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:49:24.023781 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:49:24.023871 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:49:24.023949 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:49:24.024023 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:49:24.024118 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:49:24.024181 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:49:24.024241 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:49:24.335404 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:49:25.825786 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:49:25.825882 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:49:25.825953 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:49:25.826015 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:49:25.826081 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:49:25.826153 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:49:25.826222 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:49:26.127957 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:49:41.408079 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:49:41.408163 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:49:41.408231 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:49:41.408297 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:49:41.408362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:49:41.408427 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:49:41.408487 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:49:41.719278 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:49:54.599499 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:49:54.599623 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:49:54.599681 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:49:54.599749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:49:54.599811 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:49:54.599869 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:49:54.599925 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:49:54.902813 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:49:56.388708 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:49:56.388822 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:49:56.388886 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:49:56.388944 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:49:56.389006 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:49:56.389065 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:49:56.389126 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:49:56.689202 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:50:25.170618 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:50:25.170706 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:50:25.170788 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:50:25.170861 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:50:25.170928 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:50:25.170995 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:50:25.171080 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:50:25.491474 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:50:26.953933 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:50:26.954014 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:50:26.954085 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:50:26.954160 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:50:26.954239 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:50:26.954318 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:50:26.954396 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:50:27.263502 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:50:41.535497 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:50:41.535580 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:50:41.535659 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:50:41.535727 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:50:41.535796 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:50:41.535858 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:50:41.535923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:50:41.849288 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:50:55.754646 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:50:55.754773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:50:55.754862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:50:55.754942 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:50:55.755024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:50:55.755094 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:50:55.755176 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:50:56.057437 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:50:57.524941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:50:57.525029 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:50:57.525106 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:50:57.525177 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:50:57.525252 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:50:57.525317 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:50:57.525387 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:50:57.826991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:51:26.332566 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:51:26.332647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:51:26.332711 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:51:26.332796 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:51:26.332866 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:51:26.332929 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:51:26.332997 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:51:26.634729 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:51:28.086756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:51:28.086867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:51:28.086948 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:51:28.087017 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:51:28.087108 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:51:28.087183 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:51:28.087251 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:51:28.389465 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:51:41.668680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:51:41.668777 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:51:41.668851 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:51:41.668927 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:51:41.668996 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:51:41.669064 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:51:41.669132 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:51:41.984043 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:51:56.894432 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:51:56.894512 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:51:56.894582 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:51:56.894646 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:51:56.894715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:51:56.894785 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:51:56.894853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:51:57.199526 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:51:58.649174 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:51:58.649266 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:51:58.649328 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:51:58.649396 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:51:58.649468 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:51:58.649530 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:51:58.649594 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:51:58.965307 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:52:27.466416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:52:27.466498 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:52:27.466595 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:52:27.466667 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:52:27.466736 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:52:27.466798 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:52:27.466863 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:52:27.773990 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:52:29.236696 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:52:29.236792 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:52:29.236857 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:52:29.236921 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:52:29.236982 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:52:29.237048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:52:29.237103 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:52:29.549273 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:52:41.797940 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:52:41.798041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:52:41.798119 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:52:41.798200 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:52:41.798279 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:52:41.798365 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:52:41.798448 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:52:42.139645 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:52:58.032505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:52:58.032593 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:52:58.032653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:52:58.032721 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:52:58.032789 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:52:58.032866 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:52:58.032925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:52:58.338498 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:52:59.810279 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:52:59.810383 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:52:59.810462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:52:59.810547 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:52:59.810623 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:52:59.810696 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:52:59.810779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:53:00.115272 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:53:28.602738 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:53:28.602830 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:53:28.602909 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:53:28.602992 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:53:28.603076 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:53:28.603147 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:53:28.603227 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:53:28.911621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:53:30.383694 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:53:30.383803 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:53:30.383870 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:53:30.383961 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:53:30.384038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:53:30.384105 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:53:30.384174 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:53:30.684411 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:53:41.921701 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:53:41.921795 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:53:41.921856 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:53:41.921923 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:53:41.921983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:53:41.922053 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:53:41.922116 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:53:42.251761 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:53:59.173501 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:53:59.173584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:53:59.173651 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:53:59.173713 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:53:59.173786 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:53:59.173850 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:53:59.173916 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:53:59.485670 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:54:00.941771 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:54:00.941868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:54:00.941937 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:54:00.942003 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:54:00.942073 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:54:00.942138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:54:00.942201 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:54:01.246093 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:54:29.744803 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:54:29.744883 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:54:29.744960 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:54:29.745026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:54:29.745092 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:54:29.745152 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:54:29.745220 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:54:30.054605 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:54:31.506179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:54:31.506264 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:54:31.506341 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:54:31.506411 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:54:31.506477 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:54:31.506536 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:54:31.506607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:54:31.818390 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:54:42.050906 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:54:42.050980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:54:42.051047 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:54:42.051118 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:54:42.051177 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:54:42.051241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:54:42.051310 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:54:42.363608 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:55:00.322534 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:55:00.322631 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:55:00.322706 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:55:00.322787 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:55:00.322862 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:55:00.322927 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:55:00.323000 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:55:00.627545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:55:02.089650 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:55:02.089742 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:55:02.089836 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:55:02.089899 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:55:02.089959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:55:02.090025 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:55:02.090088 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:55:02.395184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:55:30.890508 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:55:30.890597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:55:30.890668 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:55:30.890750 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:55:30.890814 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:55:30.890880 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:55:30.890940 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:55:31.196300 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:55:32.655873 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:55:32.655987 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:55:32.656063 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:55:32.656128 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:55:32.656191 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:55:32.656263 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:55:32.656324 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:55:32.957953 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:55:42.172723 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:55:42.172816 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:55:42.172896 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:55:42.172973 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:55:42.173044 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:55:42.173118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:55:42.173194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:55:42.478343 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:56:01.463287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:56:01.463381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:56:01.463441 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:56:01.463503 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:56:01.463561 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:56:01.463639 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:56:01.463715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:56:01.771905 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:56:03.224551 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:56:03.224637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:56:03.224707 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:56:03.224780 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:56:03.224852 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:56:03.224920 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:56:03.224979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:56:03.536801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:56:32.040255 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:56:32.040342 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:56:32.040403 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:56:32.040468 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:56:32.040527 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:56:32.040593 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:56:32.040655 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:56:32.366985 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:56:33.793499 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:56:33.793596 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:56:33.793670 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:56:33.793736 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:56:33.793800 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:56:33.793868 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:56:33.793930 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:56:34.096424 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:56:42.305431 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:56:42.305508 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:56:42.305571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:56:42.305636 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:56:42.305697 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:56:42.305766 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:56:42.305828 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:56:42.607625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:57:02.630056 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:57:02.630181 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:57:02.630262 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:57:02.630341 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:57:02.630427 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:57:02.630497 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:57:02.630580 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:57:02.935319 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:57:04.357873 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:57:04.358058 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:57:04.358207 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:57:04.358347 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:57:04.358485 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:57:04.358831 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:57:04.358922 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:57:04.664350 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:57:33.194755 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:57:33.194847 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:57:33.194921 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:57:33.194990 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:57:33.195054 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:57:33.195112 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:57:33.195176 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:57:33.499439 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:57:34.928930 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:57:34.929019 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:57:34.929091 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:57:34.929158 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:57:34.929219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:57:34.929281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:57:34.929342 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:57:35.236270 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:57:42.426711 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:57:42.426809 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:57:42.426871 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:57:42.426932 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:57:42.426997 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:57:42.427074 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:57:42.427134 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:57:42.739090 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:58:03.758321 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:58:03.758406 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:58:03.758474 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:58:03.758536 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:58:03.758600 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:58:03.758665 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:58:03.758733 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:58:04.065488 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:58:05.496458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:58:05.496544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:58:05.496613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:58:05.496685 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:58:05.496754 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:58:05.496818 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:58:05.496877 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:58:05.799366 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:58:34.338613 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:58:34.338702 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:58:34.338773 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:58:34.338847 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:58:34.338921 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:58:34.338988 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:58:34.339045 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:58:34.639219 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:58:36.056391 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:58:36.056480 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:58:36.056542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:58:36.056620 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:58:36.056684 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:58:36.056755 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:58:36.056812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:58:36.369388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:58:42.562836 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:58:42.562913 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:58:42.562985 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:58:42.563054 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:58:42.563120 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:58:42.563184 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:58:42.563247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:58:42.868852 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:59:04.907479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:59:04.907577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:59:04.907638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:59:04.907707 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:59:04.907775 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:59:04.907837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:59:04.907897 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:59:05.218742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:59:06.633456 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:59:06.633546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:59:06.633628 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:59:06.633698 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:59:06.633774 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:59:06.633844 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:59:06.633918 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:59:06.943742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:59:35.480979 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:59:35.481065 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:59:35.481130 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:59:35.481192 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:59:35.481255 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:59:35.481316 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:59:35.481373 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:59:35.792450 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:59:37.215056 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:59:37.215148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:59:37.215227 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:59:37.215295 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:59:37.215360 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:59:37.215443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:59:37.215504 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:59:37.518833 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-23 23:59:42.685375 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-23 23:59:42.685458 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-23 23:59:42.685521 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-23 23:59:42.685585 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-23 23:59:42.685647 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-23 23:59:42.685709 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-23 23:59:42.685778 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-23 23:59:42.989403 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:00:06.051965 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:00:06.052061 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:00:06.052138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:00:06.052200 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:00:06.052261 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:00:06.052322 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:00:06.052385 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:00:06.355436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:00:07.782821 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:00:07.782918 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:00:07.782984 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:00:07.783053 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:00:07.783127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:00:07.783188 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:00:07.783253 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:00:08.086091 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:00:36.615382 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:00:36.615463 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:00:36.615536 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:00:36.615594 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:00:36.615660 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:00:36.615722 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:00:36.615800 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:00:36.914572 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:00:38.354895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:00:38.354978 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:00:38.355040 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:00:38.355103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:00:38.355167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:00:38.355236 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:00:38.355306 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:00:38.661171 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:00:42.816981 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:00:42.817076 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:00:42.817138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:00:42.817202 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:00:42.817261 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:00:42.817320 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:00:42.817380 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:00:43.119375 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:01:07.178750 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:01:07.178832 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:01:07.178904 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:01:07.178965 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:01:07.179023 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:01:07.179082 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:01:07.179139 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:01:07.491477 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:01:08.924710 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:01:08.924798 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:01:08.924868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:01:08.924933 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:01:08.924993 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:01:08.925058 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:01:08.925116 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:01:09.233447 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:01:37.752664 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:01:37.752764 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:01:37.752828 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:01:37.752885 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:01:37.752944 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:01:37.753001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:01:37.753067 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:01:38.056919 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:01:39.510450 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:01:39.510542 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:01:39.510605 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:01:39.510675 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:01:39.510741 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:01:39.510812 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:01:39.510872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:01:39.814531 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:01:42.944382 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:01:42.944457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:01:42.944519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:01:42.944579 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:01:42.944641 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:01:42.944702 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:01:42.944772 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:01:43.251376 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:02:08.316758 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:02:08.316841 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:02:08.316903 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:02:08.316964 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:02:08.317026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:02:08.317084 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:02:08.317150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:02:08.657180 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:02:10.103952 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:02:10.104043 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:02:10.104110 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:02:10.104179 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:02:10.104241 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:02:10.104301 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:02:10.104366 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:02:10.416287 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:02:38.923650 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:02:38.923747 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:02:38.923808 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:02:38.923886 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:02:38.923943 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:02:38.924002 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:02:38.924062 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:02:39.236337 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:02:40.680994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:02:40.681094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:02:40.681165 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:02:40.681223 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:02:40.681289 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:02:40.681346 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:02:40.681407 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:02:40.984380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:02:43.066550 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:02:43.066637 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:02:43.066698 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:02:43.066772 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:02:43.066834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:02:43.066900 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:02:43.066960 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:02:43.392783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:03:09.500995 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:03:09.501081 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:03:09.501145 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:03:09.501209 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:03:09.501271 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:03:09.501330 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:03:09.501399 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:03:09.807895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:03:11.247771 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:03:11.247854 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:03:11.247923 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:03:11.247994 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:03:11.248052 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:03:11.248110 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:03:11.248172 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:03:11.549924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:03:40.086351 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:03:40.086451 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:03:40.086519 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:03:40.086590 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:03:40.086655 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:03:40.086732 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:03:40.086799 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:03:40.396503 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:03:41.818692 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:03:41.818777 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:03:41.818846 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:03:41.818909 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:03:41.818978 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:03:41.819034 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:03:41.819098 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:03:42.128079 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:03:43.186780 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:03:43.186863 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:03:43.186929 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:03:43.186996 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:03:43.187057 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:03:43.187116 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:03:43.187177 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:03:43.501172 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:04:10.665686 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:04:10.665784 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:04:10.665848 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:04:10.665915 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:04:10.665979 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:04:10.666043 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:04:10.666108 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:04:10.970204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:04:12.390146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:04:12.390240 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:04:12.390319 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:04:12.390394 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:04:12.390463 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:04:12.390534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:04:12.390613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:04:12.690793 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:04:41.228217 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:04:41.228304 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:04:41.228370 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:04:41.228435 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:04:41.228497 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:04:41.228559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:04:41.228619 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:04:41.535370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:04:42.952098 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:04:42.952188 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:04:42.952248 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:04:42.952312 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:04:42.952371 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:04:42.952443 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:04:42.952504 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:04:43.256226 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:04:43.519613 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:04:43.519703 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:04:43.519784 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:04:43.519850 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:04:43.519918 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:04:43.519984 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:04:43.520042 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:04:43.822833 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:05:11.812102 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:05:11.812187 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:05:11.812264 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:05:11.812339 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:05:11.812398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:05:11.812460 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:05:11.812534 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:05:12.120151 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:05:13.522893 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:05:13.523005 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:05:13.523098 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:05:13.523178 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:05:13.523241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:05:13.523302 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:05:13.523359 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:05:13.835581 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:05:42.381956 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:05:42.382040 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:05:42.382102 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:05:42.382166 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:05:42.382227 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:05:42.382285 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:05:42.382352 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:05:42.689292 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:05:43.433400 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:05:43.433479 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:05:43.433542 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:05:43.433609 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:05:43.433665 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:05:43.433741 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:05:43.433800 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:05:43.741427 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:05:44.098447 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:05:44.098542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:05:44.098605 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:05:44.098671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:05:44.098735 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:05:44.098801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:05:44.098861 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:05:44.411072 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:06:12.949581 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:06:12.949665 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:06:12.949736 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:06:12.949801 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:06:12.949865 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:06:12.949931 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:06:12.949991 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:06:13.255744 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:06:14.673797 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:06:14.673881 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:06:14.673943 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:06:14.674024 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:06:14.674079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:06:14.674153 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:06:14.674208 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:06:14.978850 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:06:43.522519 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:06:43.522623 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:06:43.522697 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:06:43.522781 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:06:43.522856 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:06:43.522923 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:06:43.523001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:06:43.837733 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:06:44.103750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:06:44.103831 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:06:44.103898 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:06:44.103956 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:06:44.104020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:06:44.104079 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:06:44.104141 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:06:44.419321 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:06:45.242815 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:06:45.242926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:06:45.242991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:06:45.243061 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:06:45.243122 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:06:45.243179 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:06:45.243239 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:06:45.557085 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:07:14.105700 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:07:14.105788 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:07:14.105855 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:07:14.105925 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:07:14.105982 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:07:14.106047 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:07:14.106109 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:07:14.418802 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:07:15.826730 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:07:15.826814 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:07:15.826882 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:07:15.826940 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:07:15.827012 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:07:15.827073 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:07:15.827137 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:07:16.127112 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:07:43.685819 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:07:43.685898 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:07:43.685968 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:07:43.686039 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:07:43.686101 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:07:43.686169 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:07:43.686229 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:07:44.009749 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:07:44.681265 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:07:44.681362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:07:44.681432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:07:44.681490 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:07:44.681552 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:07:44.681609 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:07:44.681678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:07:44.983381 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:07:46.393778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:07:46.393858 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:07:46.393927 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:07:46.393989 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:07:46.394053 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:07:46.394108 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:07:46.394177 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:07:46.701569 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:08:15.247197 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:08:15.247280 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:08:15.247351 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:08:15.247426 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:08:15.247491 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:08:15.247550 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:08:15.247611 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:08:15.559393 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:08:16.961186 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:08:16.961275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:08:16.961338 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:08:16.961405 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:08:16.961465 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:08:16.961535 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:08:16.961596 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:08:17.267543 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:08:43.814408 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:08:43.814488 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:08:43.814567 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:08:43.814641 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:08:43.814714 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:08:43.814810 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:08:43.814885 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:08:44.123046 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:08:45.816014 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:08:45.816102 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:08:45.816171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:08:45.816239 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:08:45.816309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:08:45.816379 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:08:45.816447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:08:46.120206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:08:47.530892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:08:47.530976 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:08:47.531039 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:08:47.531105 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:08:47.531173 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:08:47.531238 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:08:47.531303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:08:47.843852 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:09:16.378207 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:09:16.378297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:09:16.378362 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:09:16.378424 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:09:16.378486 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:09:16.378561 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:09:16.378619 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:09:16.686041 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:09:18.110108 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:09:18.110203 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:09:18.110267 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:09:18.110331 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:09:18.110395 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:09:18.110465 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:09:18.110528 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:09:18.413397 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:09:43.937521 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:09:43.937932 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:09:43.938409 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:09:43.938892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:09:43.939028 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:09:43.939100 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:09:43.939175 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:09:44.246478 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:09:46.943019 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:09:46.943133 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:09:46.943210 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:09:46.943292 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:09:46.943368 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:09:46.943443 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:09:46.943521 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:09:47.246343 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:09:48.674423 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:09:48.674509 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:09:48.674580 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:09:48.674658 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:09:48.674730 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:09:48.674798 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:09:48.674865 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:09:48.981462 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:10:17.521364 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:10:17.521492 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:10:17.521565 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:10:17.521625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:10:17.521689 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:10:17.521763 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:10:17.521838 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:10:17.834958 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:10:19.251372 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:10:19.251471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:10:19.251531 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:10:19.251601 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:10:19.251664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:10:19.251732 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:10:19.251799 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:10:19.563410 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:10:44.062260 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:10:44.062343 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:10:44.062411 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:10:44.062476 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:10:44.062545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:10:44.062606 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:10:44.062665 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:10:44.377907 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:10:48.097576 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:10:48.097701 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:10:48.097816 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:10:48.097923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:10:48.098014 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:10:48.098098 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:10:48.098201 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:10:48.413444 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:10:49.819813 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:10:49.819924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:10:49.820006 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:10:49.820086 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:10:49.820154 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:10:49.820230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:10:49.820303 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:10:50.135901 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:11:18.684200 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:11:18.684301 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:11:18.684377 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:11:18.684443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:11:18.684514 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:11:18.684588 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:11:18.684650 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:11:18.986266 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:11:20.402716 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:11:20.402830 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:11:20.402904 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:11:20.402964 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:11:20.403032 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:11:20.403090 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:11:20.403157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:11:20.714670 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:11:44.189071 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:11:44.189173 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:11:44.189254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:11:44.189334 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:11:44.189417 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:11:44.189508 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:11:44.189583 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:11:44.499632 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:11:49.249007 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:11:49.249113 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:11:49.249191 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:11:49.249278 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:11:49.249359 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:11:49.249450 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:11:49.249530 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:11:49.559442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:11:50.973867 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:11:50.974138 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:11:50.974280 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:11:50.975010 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:11:50.975130 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:11:50.975250 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:11:50.975333 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:11:51.281378 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:12:19.822119 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:12:19.822224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:12:19.822290 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:12:19.822363 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:12:19.822435 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:12:19.822504 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:12:19.822570 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:12:20.133138 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:12:21.542741 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:12:21.542827 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:12:21.542897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:12:21.542977 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:12:21.543037 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:12:21.543102 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:12:21.543171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:12:21.848315 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:12:44.320436 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:12:44.320535 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:12:44.320615 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:12:44.320691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:12:44.320779 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:12:44.320859 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:12:44.320941 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:12:44.629809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:12:50.406303 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:12:50.406399 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:12:50.406483 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:12:50.406572 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:12:50.406644 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:12:50.406736 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:12:50.406821 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:12:50.710277 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:12:52.124933 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:12:52.125049 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:12:52.125135 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:12:52.125225 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:12:52.125305 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:12:52.125398 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:12:52.125480 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:12:52.439195 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:13:20.971299 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:13:20.971462 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:13:20.971548 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:13:20.971628 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:13:20.971708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:13:20.971819 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:13:20.971912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:13:21.284337 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:13:22.701214 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:13:22.701324 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:13:22.701399 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:13:22.701475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:13:22.701554 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:13:22.701626 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:13:22.701696 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:13:23.009006 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:13:44.446872 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:13:44.446955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:13:44.447019 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:13:44.447086 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:13:44.447154 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:13:44.447218 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:13:44.447283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:13:44.754076 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:13:51.548779 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:13:51.548868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:13:51.548936 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:13:51.549001 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:13:51.549063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:13:51.549128 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:13:51.549188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:13:51.849555 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:13:53.268469 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:13:53.268599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:13:53.268685 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:13:53.268780 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:13:53.268866 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:13:53.268961 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:13:53.269043 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:13:53.577387 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:14:22.110485 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:14:22.110587 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:14:22.110678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:14:22.110787 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:14:22.110879 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:14:22.110959 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:14:22.111045 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:14:22.418630 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:14:23.838942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:14:23.839054 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:14:23.839154 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:14:23.839229 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:14:23.839300 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:14:23.839406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:14:23.839496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:14:24.150571 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:14:44.570537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:14:44.570636 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:14:44.570725 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:14:44.570803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:14:44.570876 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:14:44.570947 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:14:44.571026 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:14:44.874167 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:14:52.682198 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:14:52.682316 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:14:52.682408 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:14:52.682486 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:14:52.682566 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:14:52.682643 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:14:52.682721 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:14:52.989825 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:14:54.408016 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:14:54.408118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:14:54.408196 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:14:54.408274 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:14:54.408351 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:14:54.408426 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:14:54.408498 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:14:54.715465 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:15:23.252614 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:15:23.252711 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:15:23.252787 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:15:23.252853 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:15:23.252921 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:15:23.252997 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:15:23.253061 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:15:23.565047 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:15:24.980844 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:15:24.980921 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:15:24.980994 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:15:24.981053 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:15:24.981119 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:15:24.981184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:15:24.981244 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:15:25.289449 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:15:44.693815 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:15:44.693909 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:15:44.693980 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:15:44.694059 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:15:44.694128 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:15:44.694192 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:15:44.694270 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:15:45.004966 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:15:53.824416 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:15:53.824507 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:15:53.824592 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:15:53.824663 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:15:53.824762 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:15:53.824841 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:15:53.824918 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:15:54.127395 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:15:55.549198 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:15:55.549311 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:15:55.549384 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:15:55.549456 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:15:55.549526 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:15:55.549596 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:15:55.549671 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:15:55.859096 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:16:24.405092 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:16:24.405179 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:16:24.405253 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:16:24.405316 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:16:24.405405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:16:24.405473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:16:24.405538 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:16:24.721908 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:16:26.117453 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:16:26.117544 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:16:26.117613 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:16:26.117679 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:16:26.117744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:16:26.117814 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:16:26.117877 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:16:26.423098 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:16:44.815281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:16:44.815403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:16:44.815486 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:16:44.815575 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:16:44.816690 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:16:44.817060 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:16:44.817671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:16:45.123490 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:16:54.990803 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:16:54.990919 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:16:54.991010 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:16:54.991081 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:16:54.991156 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:16:54.991224 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:16:54.991316 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:16:55.300424 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:16:56.687346 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:16:56.687426 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:16:56.687496 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:16:56.687558 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:16:56.687626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:16:56.687688 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:16:56.687761 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:16:56.985488 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:17:25.564683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:17:25.564816 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:17:25.564881 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:17:25.564946 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:17:25.565007 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:17:25.565080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:17:25.565141 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:17:25.872443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:17:27.246919 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:17:27.247020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:17:27.247089 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:17:27.247151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:17:27.247218 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:17:27.247287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:17:27.247352 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:17:27.548779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:17:44.936251 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:17:44.936356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:17:44.936432 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:17:44.936522 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:17:44.936603 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:17:44.936681 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:17:44.936761 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:17:45.242662 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:17:56.133353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:17:56.133452 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:17:56.133540 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:17:56.133614 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:17:56.133693 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:17:56.133778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:17:56.133863 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:17:56.446654 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:17:57.812457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:17:57.812549 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:17:57.812627 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:17:57.812701 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:17:57.812782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:17:57.812865 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:17:57.812938 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:17:58.115892 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:18:26.711473 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:18:26.711585 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:18:26.711664 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:18:26.711752 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:18:26.711848 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:18:26.711916 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:18:26.712004 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:18:27.019444 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:18:28.379599 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:18:28.379687 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:18:28.379783 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:18:28.379850 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:18:28.379922 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:18:28.379991 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:18:28.380057 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:18:28.680851 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:18:45.059439 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:18:45.059524 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:18:45.059595 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:18:45.059658 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:18:45.059737 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:18:45.059801 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:18:45.059865 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:18:45.374434 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:18:57.288157 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:18:57.288842 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:18:57.288952 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:18:57.289039 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:18:57.289121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:18:57.289183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:18:57.289246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:18:57.596280 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:18:58.945900 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:18:58.946017 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:18:58.946082 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:18:58.946146 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:18:58.946207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:18:58.946270 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:18:58.946336 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:18:59.259912 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:19:27.855098 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:19:27.855176 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:19:27.855242 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:19:27.855302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:19:27.855367 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:19:27.855432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:19:27.855494 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:19:28.160034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:19:29.522146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:19:29.522225 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:19:29.522299 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:19:29.522359 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:19:29.522421 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:19:29.522483 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:19:29.522550 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:19:29.825626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:19:45.176564 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:19:45.176648 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:19:45.176715 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:19:45.176793 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:19:45.176851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:19:45.176917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:19:45.176978 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:19:45.486661 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:19:58.422741 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:19:58.422825 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:19:58.422892 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:19:58.422951 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:19:58.423009 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:19:58.423071 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:19:58.423129 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:19:58.737373 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:20:00.104253 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:20:00.104362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:20:00.104441 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:20:00.104525 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:20:00.104608 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:20:00.104686 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:20:00.104761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:20:00.410083 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:20:29.013559 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:20:29.013665 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:20:29.013738 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:20:29.013813 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:20:29.013879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:20:29.013946 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:20:29.014007 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:20:29.326411 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:20:30.671010 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:20:30.671137 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:20:30.671224 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:20:30.671303 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:20:30.671375 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:20:30.671458 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:20:30.671536 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:20:30.977999 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:20:45.303428 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:20:45.303531 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:20:45.303605 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:20:45.303682 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:20:45.303784 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:20:45.303869 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:20:45.303951 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:20:45.608348 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:20:59.591627 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:20:59.591734 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:20:59.591809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:20:59.591880 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:20:59.591955 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:20:59.592025 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:20:59.592098 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:20:59.893816 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:21:01.237645 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:21:01.237746 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:21:01.237819 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:21:01.237902 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:21:01.237976 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:21:01.238052 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:21:01.238126 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:21:01.548908 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:21:30.158291 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:21:30.158381 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:21:30.158451 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:21:30.158521 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:21:30.158592 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:21:30.159742 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:21:30.160131 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:21:30.462700 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:21:31.823547 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:21:31.823637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:21:31.823702 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:21:31.823776 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:21:31.823842 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:21:31.823914 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:21:31.823979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:21:32.145136 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:21:45.429932 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:21:45.430045 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:21:45.430126 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:21:45.430204 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:21:45.430283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:21:45.430365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:21:45.430446 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:21:45.728265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:22:00.718858 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:22:00.718984 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:22:00.719057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:22:00.719131 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:22:00.719212 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:22:00.719280 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:22:00.719350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:22:01.028609 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:22:02.420559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:22:02.420648 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:22:02.420724 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:22:02.420787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:22:02.420851 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:22:02.420918 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:22:02.420976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:22:02.729625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:22:31.292835 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:22:31.292921 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:22:31.292992 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:22:31.293054 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:22:31.293123 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:22:31.293182 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:22:31.293245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:22:31.599631 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:22:32.991162 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:22:32.991259 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:22:32.991361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:22:32.991446 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:22:32.991534 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:22:32.992282 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:22:32.992888 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:22:33.303629 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:22:45.560055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:22:45.560159 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:22:45.560246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:22:45.560324 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:22:45.560404 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:22:45.560481 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:22:45.560572 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:22:45.864572 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:23:01.861089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:23:01.861204 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:23:01.861296 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:23:01.861373 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:23:01.861450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:23:01.861531 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:23:01.861606 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:23:02.167697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:23:03.567661 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:23:03.567776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:23:03.567854 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:23:03.567942 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:23:03.568008 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:23:03.568089 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:23:03.568162 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:23:03.867881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:23:32.431770 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:23:32.431867 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:23:32.431943 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:23:32.432019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:23:32.432077 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:23:32.432139 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:23:32.432203 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:23:32.742008 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:23:34.131268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:23:34.131392 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:23:34.131472 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:23:34.131545 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:23:34.131629 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:23:34.131707 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:23:34.131786 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:23:34.442577 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:23:45.690145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:23:45.690230 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:23:45.690301 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:23:45.690369 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:23:45.690435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:23:45.690497 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:23:45.690557 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:23:45.998112 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:24:02.999579 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:24:02.999664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:24:02.999736 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:24:02.999800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:24:02.999862 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:24:02.999925 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:24:02.999988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:24:03.307079 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:24:04.708954 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:24:04.709049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:24:04.709114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:24:04.709180 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:24:04.709245 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:24:04.709305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:24:04.709368 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:24:05.020461 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:24:33.572211 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:24:33.572294 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:24:33.572359 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:24:33.572427 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:24:33.572492 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:24:33.572551 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:24:33.572613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:24:33.883562 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:24:35.287743 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:24:35.287832 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:24:35.287902 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:24:35.287964 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:24:35.288026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:24:35.288085 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:24:35.288150 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:24:35.598469 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:24:45.821160 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:24:45.821772 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:24:45.822620 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:24:45.822710 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:24:45.822813 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:24:45.822893 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:24:45.822959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:24:46.127618 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:25:04.138808 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:25:04.138885 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:25:04.138947 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:25:04.139006 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:25:04.139069 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:25:04.139129 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:25:04.139192 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:25:04.449705 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:25:05.857489 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:25:05.857578 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:25:05.857649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:25:05.857709 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:25:05.857776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:25:05.857841 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:25:05.857902 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:25:06.159894 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:25:34.714575 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:25:34.714680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:25:34.714750 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:25:34.714817 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:25:34.714878 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:25:34.714942 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:25:34.715004 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:25:35.028928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:25:36.418265 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:25:36.418352 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:25:36.418416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:25:36.418480 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:25:36.418547 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:25:36.418613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:25:36.418676 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:25:36.720991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:25:45.946094 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:25:45.946179 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:25:45.946254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:25:45.946323 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:25:45.946379 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:25:45.946447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:25:45.946513 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:25:46.246678 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:26:05.298439 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:26:05.298532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:26:05.298649 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:26:05.298739 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:26:05.298803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:26:05.298866 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:26:05.298930 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:26:05.611588 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:26:06.986309 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:26:06.986409 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:26:06.986473 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:26:06.986542 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:26:06.986605 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:26:06.986673 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:26:06.986745 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:26:07.290229 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:26:35.878996 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:26:35.879106 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:26:35.879169 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:26:35.879230 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:26:35.879297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:26:35.879360 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:26:35.879424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:26:36.181426 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:26:37.553310 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:26:37.553407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:26:37.553485 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:26:37.553569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:26:37.553638 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:26:37.553703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:26:37.553789 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:26:37.857669 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:26:46.074183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:26:46.074274 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:26:46.074353 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:26:46.074423 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:26:46.074491 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:26:46.074584 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:26:46.074657 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:26:46.379351 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:27:06.441529 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:27:06.441627 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:27:06.441698 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:27:06.441774 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:27:06.441834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:27:06.441896 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:27:06.441974 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:27:06.749818 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:27:08.114943 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:27:08.115037 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:27:08.115117 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:27:08.115199 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:27:08.115279 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:27:08.115351 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:27:08.115426 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:27:08.417153 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:27:37.012170 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:27:37.012281 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:27:37.012355 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:27:37.012423 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:27:37.012490 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:27:37.012558 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:27:37.012627 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:27:37.319257 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:27:38.674181 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:27:38.674275 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:27:38.674341 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:27:38.674409 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:27:38.674471 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:27:38.674538 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:27:38.674598 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:27:38.987165 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:27:46.199196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:27:46.199278 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:27:46.199339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:27:46.199405 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:27:46.199469 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:27:46.199533 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:27:46.199592 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:27:46.511527 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:28:07.574688 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:28:07.574777 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:28:07.574845 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:28:07.574918 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:28:07.574980 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:28:07.575038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:28:07.575102 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:28:07.879852 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:28:09.247786 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:28:09.247869 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:28:09.247938 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:28:09.248988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:28:09.249180 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:28:09.249337 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:28:09.249465 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:28:09.558707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:28:38.142777 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:28:38.142874 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:28:38.142943 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:28:38.143005 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:28:38.143072 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:28:38.143140 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:28:38.143204 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:28:38.457592 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:28:39.825014 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:28:39.825093 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:28:39.825164 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:28:39.825227 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:28:39.825293 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:28:39.825364 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:28:39.825427 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:28:40.129523 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:28:46.328292 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:28:46.328373 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:28:46.328433 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:28:46.328498 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:28:46.328559 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:28:46.328626 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:28:46.328682 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:28:46.637063 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:29:08.718961 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:29:08.719052 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:29:08.719138 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:29:08.719203 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:29:08.719262 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:29:08.719330 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:29:08.719395 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:29:09.029736 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:29:10.385654 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:29:10.385769 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:29:10.385836 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:29:10.385904 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:29:10.385963 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:29:10.386024 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:29:10.386083 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:29:10.690280 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:29:39.310029 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:29:39.310453 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:29:39.310530 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:29:39.310637 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:29:39.310706 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:29:39.310777 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:29:39.310851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:29:39.623142 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:29:40.950846 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:29:40.950931 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:29:40.951015 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:29:40.951080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:29:40.951149 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:29:40.951207 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:29:40.951274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:29:41.256433 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:29:46.453768 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:29:46.453863 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:29:46.453946 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:29:46.454022 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:29:46.454116 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:29:46.454191 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:29:46.454271 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:29:46.757904 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:30:09.882974 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:30:09.883073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:30:09.883148 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:30:09.883223 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:30:09.883299 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:30:09.883372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:30:09.883447 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:30:10.194760 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:30:11.523935 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:30:11.524018 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:30:11.524087 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:30:11.524152 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:30:11.524218 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:30:11.524278 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:30:11.524342 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:30:11.829381 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:30:40.454424 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:30:40.454503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:30:40.454588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:30:40.454647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:30:40.454706 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:30:40.454770 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:30:40.454835 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:30:40.759025 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:30:42.093361 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:30:42.093452 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:30:42.093521 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:30:42.093586 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:30:42.093646 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:30:42.093702 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:30:42.093784 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:30:42.408855 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:30:46.534634 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:30:46.534725 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:30:46.534789 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:30:46.534862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:30:46.534939 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:30:46.535006 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:30:46.535066 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:30:46.836263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:31:11.020666 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:31:11.020760 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:31:11.020829 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:31:11.020888 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:31:11.020954 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:31:11.021018 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:31:11.021078 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:31:11.315466 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:31:12.667596 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:31:12.667687 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:31:12.667756 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:31:12.667824 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:31:12.667888 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:31:12.667951 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:31:12.668014 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:31:12.976510 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:31:41.577238 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:31:41.577319 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:31:41.577388 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:31:41.577447 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:31:41.577515 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:31:41.577576 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:31:41.577637 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:31:41.887011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:31:43.238067 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:31:43.238149 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:31:43.238215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:31:43.238285 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:31:43.238351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:31:43.238413 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:31:43.238475 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:31:43.544360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:31:46.654114 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:31:46.654197 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:31:46.654260 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:31:46.654883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:31:46.655497 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:31:46.656061 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:31:46.656546 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:31:46.971899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:32:12.153215 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:32:12.153330 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:32:12.153396 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:32:12.153464 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:32:12.153526 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:32:12.153590 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:32:12.153653 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:32:12.466355 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:32:13.809654 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:32:13.809737 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:32:13.809802 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:32:13.809873 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:32:13.809940 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:32:13.810001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:32:13.810063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:32:14.117586 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:32:42.732277 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:32:42.732362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:32:42.732427 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:32:42.732494 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:32:42.732557 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:32:42.732620 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:32:42.732683 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:32:43.042521 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:32:44.391670 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:32:44.391771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:32:44.391835 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:32:44.391900 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:32:44.391969 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:32:44.392028 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:32:44.392087 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:32:44.700460 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:32:46.779910 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:32:46.780019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:32:46.780083 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:32:46.780150 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:32:46.780209 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:32:46.780275 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:32:46.780351 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:32:47.082183 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:33:13.302909 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:33:13.302990 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:33:13.303054 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:33:13.303121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:33:13.303195 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:33:13.303257 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:33:13.303334 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:33:13.605953 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:33:14.970430 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:33:14.970529 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:33:14.970599 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:33:14.970672 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:33:14.970763 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:33:14.970835 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:33:14.970918 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:33:15.279279 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:33:43.874065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:33:43.874163 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:33:43.874238 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:33:43.874310 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:33:43.874380 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:33:43.874454 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:33:43.874519 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:33:44.176945 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:33:45.542090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:33:45.542183 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:33:45.542251 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:33:45.542316 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:33:45.542375 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:33:45.542435 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:33:45.542499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:33:45.849712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:33:46.902230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:33:46.902322 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:33:46.902395 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:33:46.902472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:33:46.902549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:33:46.902626 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:33:46.902705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:33:47.207945 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:34:14.438281 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:34:14.438387 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:34:14.438477 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:34:14.438550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:34:14.438622 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:34:14.438702 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:34:14.438801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:34:14.749105 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:34:16.115732 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:34:16.115821 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:34:16.115899 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:34:16.115972 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:34:16.116048 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:34:16.116121 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:34:16.116194 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:34:16.416955 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:34:45.013081 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:34:45.013168 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:34:45.013239 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:34:45.013301 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:34:45.013368 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:34:45.013429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:34:45.013500 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:34:45.320784 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:34:46.676712 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:34:46.676822 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:34:46.676912 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:34:46.676975 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:34:46.677038 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:34:46.677099 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:34:46.677160 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:34:46.987739 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:34:47.247310 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:34:47.247395 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:34:47.247462 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:34:47.247534 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:34:47.247597 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:34:47.247661 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:34:47.247727 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:34:47.550434 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:35:15.592824 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:35:15.592921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:35:15.592995 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:35:15.594143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:35:15.594616 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:35:15.595356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:35:15.596116 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:35:15.902352 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:35:17.249100 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:35:17.249185 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:35:17.249250 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:35:17.249332 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:35:17.249405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:35:17.249467 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:35:17.249532 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:35:17.560484 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:35:46.167101 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:35:46.167194 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:35:46.167277 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:35:46.167356 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:35:46.167429 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:35:46.167499 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:35:46.167577 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:35:46.475561 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:35:47.149474 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:35:47.149561 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:35:47.149649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:35:47.149714 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:35:47.149788 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:35:47.149862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:35:47.149945 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:35:47.456043 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:35:47.825332 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:35:47.825425 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:35:47.825492 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:35:47.825563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:35:47.825629 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:35:47.825702 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:35:47.825767 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:35:48.125767 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:36:16.735924 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:36:16.736007 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:36:16.736073 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:36:16.736141 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:36:16.736204 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:36:16.736269 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:36:16.736331 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:36:17.041949 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:36:18.393286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:36:18.393432 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:36:18.393541 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:36:18.393639 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:36:18.393744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:36:18.393834 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:36:18.393944 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:36:18.696000 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:36:47.273744 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:36:47.273836 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:36:47.273906 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:36:47.273983 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:36:47.274052 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:36:47.274120 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:36:47.274184 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:36:47.579539 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:36:47.846685 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:36:47.846767 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:36:47.846836 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:36:47.846897 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:36:47.846961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:36:47.847024 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:36:47.847087 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:36:48.155991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:36:48.957288 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:36:48.957404 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:36:48.957479 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:36:48.957559 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:36:48.957637 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:36:48.957715 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:36:48.957793 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:36:49.268599 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:37:17.849253 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:37:17.849368 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:37:17.849438 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:37:17.849500 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:37:17.849568 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:37:17.849636 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:37:17.849701 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:37:18.159852 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:37:19.528775 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:37:19.528889 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:37:19.528981 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:37:19.529051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:37:19.529131 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:37:19.529204 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:37:19.529283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:37:19.831605 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:37:47.401562 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:37:47.401656 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:37:47.401747 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:37:47.401836 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:37:47.401915 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:37:47.401991 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:37:47.402072 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:37:47.711371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:37:48.421333 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:37:48.421448 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:37:48.421527 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:37:48.421606 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:37:48.421688 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:37:48.421773 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:37:48.421844 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:37:48.725664 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:37:50.105324 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:37:50.105475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:37:50.105613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:37:50.105768 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:37:50.105915 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:37:50.106055 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:37:50.106187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:37:50.421400 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:38:18.982024 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:38:18.982127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:38:18.982199 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:38:18.982276 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:38:18.982354 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:38:18.982430 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:38:18.982512 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:38:19.293643 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:38:20.683569 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:38:20.683669 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:38:20.683758 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:38:20.683834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:38:20.683907 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:38:20.683983 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:38:20.684051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:38:20.984119 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:38:47.520825 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:38:47.520904 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:38:47.520973 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:38:47.521040 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:38:47.521113 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:38:47.521208 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:38:47.521280 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:38:47.825734 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:38:49.568313 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:38:49.568431 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:38:49.568533 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:38:49.568615 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:38:49.568691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:38:49.568789 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:38:49.568868 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:38:49.870528 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:38:51.244166 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:38:51.244268 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:38:51.244348 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:38:51.244416 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:38:51.244487 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:38:51.244555 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:38:51.244626 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:38:51.560884 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:39:20.138627 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:39:20.138724 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:39:20.138790 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:39:20.138856 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:39:20.138918 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:39:20.138984 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:39:20.139045 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:39:20.440830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:39:21.828154 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:39:21.828241 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:39:21.828310 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:39:21.828374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:39:21.828442 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:39:21.828505 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:39:21.828564 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:39:22.138186 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:39:47.642872 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:39:47.642966 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:39:47.643051 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:39:47.643137 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:39:47.643247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:39:47.643321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:39:47.643405 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:39:47.961214 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:39:50.696037 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:39:50.696124 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:39:50.696204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:39:50.696282 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:39:50.696362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:39:50.696442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:39:50.696518 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:39:50.995221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:39:52.405426 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:39:52.405518 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:39:52.405589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:39:52.405662 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:39:52.405738 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:39:52.405806 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:39:52.405877 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:39:52.705368 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:40:21.263920 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:40:21.264027 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:40:21.264092 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:40:21.264159 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:40:21.264235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:40:21.264309 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:40:21.264373 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:40:21.581049 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:40:22.963846 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:40:22.963950 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:40:22.964052 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:40:22.964160 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:40:22.964264 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:40:22.964355 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:40:22.964450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:40:23.262947 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:40:47.764569 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:40:47.764677 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:40:47.764771 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:40:47.764859 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:40:47.764940 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:40:47.765035 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:40:47.765110 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:40:48.070930 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:40:51.851650 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:40:51.851753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:40:51.851851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:40:51.851920 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:40:51.852022 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:40:51.852108 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:40:51.852195 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:40:52.176114 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:40:53.521754 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:40:53.522077 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:40:53.522242 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:40:53.522409 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:40:53.523152 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:40:53.523254 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:40:53.523362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:40:53.827091 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:41:22.439695 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:41:22.439792 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:41:22.439863 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:41:22.439931 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:41:22.440004 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:41:22.440073 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:41:22.440135 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:41:22.747034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:41:24.092271 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:41:24.092355 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:41:24.092422 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:41:24.092484 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:41:24.092544 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:41:24.092615 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:41:24.092674 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:41:24.407301 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:41:47.884893 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:41:47.884979 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:41:47.885037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:41:47.885111 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:41:47.885176 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:41:47.885236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:41:47.885306 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:41:48.188578 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:41:53.016336 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:41:53.016425 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:41:53.016489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:41:53.016571 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:41:53.016644 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:41:53.016708 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:41:53.016770 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:41:53.327778 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:41:54.674683 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:41:54.674812 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:41:54.674900 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:41:54.674980 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:41:54.675062 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:41:54.675149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:41:54.675227 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:41:54.983154 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:42:23.587593 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:42:23.587688 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:42:23.587760 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:42:23.587833 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:42:23.587900 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:42:23.587958 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:42:23.588027 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:42:23.891788 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:42:25.259338 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:42:25.259439 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:42:25.259500 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:42:25.259581 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:42:25.259641 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:42:25.259707 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:42:25.259769 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:42:25.565916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:42:48.009532 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:42:48.009614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:42:48.009684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:42:48.009750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:42:48.009822 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:42:48.009879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:42:48.009942 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:42:48.318525 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:42:54.154218 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:42:54.154300 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:42:54.154386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:42:54.154451 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:42:54.154521 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:42:54.154585 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:42:54.154652 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:42:54.457105 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:42:55.826605 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:42:55.826692 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:42:55.826769 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:42:55.826837 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:42:55.826905 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:42:55.826972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:42:55.827046 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:42:56.132961 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:43:24.721063 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:43:24.721168 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:43:24.721239 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:43:24.721316 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:43:24.721382 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:43:24.721462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:43:24.721537 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:43:25.033865 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:43:26.393853 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:43:26.393948 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:43:26.394025 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:43:26.394105 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:43:26.394180 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:43:26.394262 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:43:26.394341 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:43:26.698561 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:43:48.137040 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:43:48.137131 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:43:48.137205 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:43:48.137276 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:43:48.137345 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:43:48.137415 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:43:48.137484 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:43:48.454473 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:43:55.304805 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:43:55.304909 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:43:55.304993 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:43:55.305073 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:43:55.305152 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:43:55.305225 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:43:55.305298 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:43:55.612645 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:43:56.957927 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:43:56.958016 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:43:56.958087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:43:56.958163 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:43:56.958234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:43:56.958306 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:43:56.958374 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:43:57.262412 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:44:25.874188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:44:25.874281 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:44:25.874350 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:44:25.874422 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:44:25.874514 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:44:25.874586 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:44:25.874654 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:44:26.177987 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:44:27.529455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:44:27.529544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:44:27.529612 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:44:27.529675 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:44:27.529751 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:44:27.529815 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:44:27.529884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:44:27.827837 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:44:48.272879 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:44:48.272956 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:44:48.273021 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:44:48.273082 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:44:48.273151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:44:48.273213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:44:48.273277 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:44:48.585341 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:44:56.441297 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:44:56.441394 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:44:56.441462 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:44:56.441526 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:44:56.441586 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:44:56.441645 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:44:56.441704 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:44:56.754163 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:44:58.087164 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:44:58.087245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:44:58.087314 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:44:58.087380 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:44:58.087443 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:44:58.087505 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:44:58.087564 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:44:58.394185 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:45:27.017569 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:45:27.017655 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:45:27.017749 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:45:27.017820 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:45:27.017884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:45:27.017944 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:45:27.018021 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:45:27.330633 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:45:28.656684 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:45:28.656786 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:45:28.656847 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:45:28.656906 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:45:28.656970 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:45:28.657036 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:45:28.657103 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:45:28.962161 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:45:48.394646 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:45:48.394731 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:45:48.394802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:45:48.394869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:45:48.394936 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:45:48.394999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:45:48.395071 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:45:48.702467 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:45:57.593404 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:45:57.593497 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:45:57.593573 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:45:57.593635 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:45:57.593703 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:45:57.593778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:45:57.593845 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:45:57.896589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:45:59.230922 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:45:59.231008 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:45:59.231083 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:45:59.231155 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:45:59.231223 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:45:59.231285 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:45:59.231356 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:45:59.533115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:46:28.158399 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:46:28.158489 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:46:28.158552 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:46:28.158614 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:46:28.158680 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:46:28.158748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:46:28.158807 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:46:28.474358 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:46:29.799133 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:46:29.799221 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:46:29.799286 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:46:29.799355 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:46:29.799428 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:46:29.799492 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:46:29.799556 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:46:30.113159 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:46:48.518997 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:46:48.519142 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:46:48.519237 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:46:48.519305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:46:48.519387 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:46:48.519486 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:46:48.519587 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:46:48.825975 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:46:58.733895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:46:58.733988 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:46:58.734069 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:46:58.734145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:46:58.734223 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:46:58.734300 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:46:58.734377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:46:59.058773 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:47:00.375803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:47:00.375899 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:47:00.375978 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:47:00.376058 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:47:00.376126 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:47:00.376196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:47:00.376265 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:47:00.684922 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:47:29.333855 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:47:29.333980 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:47:29.334065 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:47:29.334136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:47:29.334227 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:47:29.334311 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:47:29.334382 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:47:29.631654 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:47:30.943588 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:47:30.943704 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:47:30.943794 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:47:30.943867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:47:30.943942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:47:30.944021 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:47:30.944092 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:47:31.254246 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:47:48.640580 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:47:48.640692 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:47:48.640774 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:47:48.640860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:47:48.640932 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:47:48.641009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:47:48.641086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:47:48.952412 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:47:59.899451 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:47:59.899560 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:47:59.899650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:47:59.899749 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:47:59.899826 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:47:59.899901 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:47:59.899992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:48:00.202370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:48:01.523842 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:48:01.523946 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:48:01.524018 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:48:01.524089 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:48:01.524156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:48:01.524228 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:48:01.524300 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:48:01.833967 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:48:30.460142 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:48:30.460245 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:48:30.460308 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:48:30.460376 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:48:30.460448 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:48:30.460514 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:48:30.460574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:48:30.768490 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:48:32.105120 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:48:32.105200 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:48:32.105276 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:48:32.105338 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:48:32.105399 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:48:32.105465 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:48:32.105538 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:48:32.411108 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:48:48.761459 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:48:48.761551 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:48:48.761619 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:48:48.761684 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:48:48.761753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:48:48.761819 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:48:48.761880 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:48:49.067965 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:49:01.030641 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:49:01.030779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:49:01.030842 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:49:01.030916 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:49:01.030977 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:49:01.031040 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:49:01.031103 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:49:01.335595 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:49:02.667925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:49:02.668038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:49:02.668105 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:49:02.668177 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:49:02.668241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:49:02.668308 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:49:02.668380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:49:02.977608 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:49:31.610365 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:49:31.610465 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:49:31.610556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:49:31.610656 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:49:31.610747 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:49:31.610829 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:49:31.610911 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:49:31.922156 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:49:33.237637 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:49:33.237748 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:49:33.237824 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:49:33.237914 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:49:33.237992 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:49:33.238063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:49:33.238133 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:49:33.546673 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:49:48.884407 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:49:48.884523 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:49:48.884600 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:49:48.884675 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:49:48.884775 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:49:48.884852 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:49:48.884944 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:49:49.189377 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:50:02.205486 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:50:02.205589 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:50:02.205665 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:50:02.205752 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:50:02.205826 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:50:02.205900 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:50:02.205974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:50:02.510256 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:50:03.810144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:50:03.810244 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:50:03.810362 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:50:03.810451 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:50:03.810513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:50:03.810575 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:50:03.810637 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:50:04.116047 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:50:32.773610 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:50:32.773707 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:50:32.773799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:50:32.773866 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:50:32.773932 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:50:32.773995 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:50:32.774065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:50:33.080492 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:50:34.406897 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:50:34.406996 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:50:34.407061 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:50:34.407121 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:50:34.407181 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:50:34.407248 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:50:34.407308 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:50:34.716656 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:50:49.007004 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:50:49.007096 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:50:49.007163 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:50:49.007233 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:50:49.007302 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:50:49.007374 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:50:49.007442 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:50:49.317084 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:51:03.338479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:51:03.338580 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:51:03.338655 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:51:03.338731 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:51:03.338811 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:51:03.338873 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:51:03.338938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:51:03.645607 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:51:04.987693 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:51:04.987798 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:51:04.987862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:51:04.987933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:51:04.988001 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:51:04.988060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:51:04.988123 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:51:05.291922 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:51:33.907428 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:51:33.907539 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:51:33.907608 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:51:33.907673 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:51:33.907758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:51:33.907822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:51:33.907890 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:51:34.223342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:51:35.550432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:51:35.550517 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:51:35.550596 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:51:35.550656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:51:35.550730 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:51:35.550788 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:51:35.550854 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:51:35.853011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:51:49.133689 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:51:49.133790 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:51:49.133855 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:51:49.133923 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:51:49.133988 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:51:49.134065 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:51:49.134123 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:51:49.448826 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:52:04.485930 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:52:04.486026 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:52:04.486091 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:52:04.486151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:52:04.486224 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:52:04.486281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:52:04.486341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:52:04.793799 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:52:06.114797 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:52:06.114907 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:52:06.114968 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:52:06.115040 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:52:06.115107 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:52:06.115170 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:52:06.115230 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:52:06.422723 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:52:35.061075 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:52:35.061164 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:52:35.061247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:52:35.061329 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:52:35.061398 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:52:35.061464 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:52:35.061544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:52:35.364745 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:52:36.686276 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:52:36.686366 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:52:36.686434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:52:36.686495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:52:36.686561 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:52:36.686626 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:52:36.686684 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:52:36.994156 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:52:49.257012 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:52:49.257103 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:52:49.257166 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:52:49.257224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:52:49.257289 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:52:49.257351 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:52:49.257417 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:52:49.563730 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:53:05.638021 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:53:05.638142 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:53:05.638222 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:53:05.638299 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:53:05.638375 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:53:05.638461 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:53:05.638538 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:53:05.947923 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:53:07.256051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:53:07.256157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:53:07.256235 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:53:07.256304 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:53:07.256371 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:53:07.256446 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:53:07.256515 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:53:07.559656 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:53:36.216829 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:53:36.216920 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:53:36.217017 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:53:36.217085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:53:36.217154 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:53:36.217236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:53:36.217306 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:53:36.523117 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:53:37.820130 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:53:37.820216 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:53:37.820294 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:53:37.820359 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:53:37.820420 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:53:37.820487 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:53:37.820545 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:53:38.129019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:53:49.382051 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:53:49.382132 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:53:49.382206 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:53:49.382266 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:53:49.382340 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:53:49.382405 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:53:49.382468 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:53:49.694192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:54:06.788675 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:54:06.788776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:54:06.788840 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:54:06.788904 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:54:06.788965 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:54:06.789028 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:54:06.789092 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:54:07.093960 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:54:08.390364 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:54:08.390479 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:54:08.390557 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:54:08.390644 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:54:08.390722 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:54:08.390805 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:54:08.390881 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:54:08.691826 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:54:37.356516 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:54:37.356625 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:54:37.356706 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:54:37.356810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:54:37.356888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:54:37.356968 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:54:37.357048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:54:37.670910 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:54:38.952531 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:54:38.952618 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:54:38.952694 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:54:38.952801 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:54:38.952908 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:54:38.952993 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:54:38.953059 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:54:39.266744 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:54:49.502892 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:54:49.502976 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:54:49.503053 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:54:49.503122 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:54:49.503189 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:54:49.503256 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:54:49.503319 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:54:49.809762 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:55:07.933520 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:55:07.933615 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:55:07.933678 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:55:07.933757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:55:07.933822 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:55:07.933885 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:55:07.933943 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:55:08.240758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:55:09.524489 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:55:09.524614 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:55:09.524693 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:55:09.524772 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:55:09.524845 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:55:09.524910 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:55:09.524980 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:55:09.834911 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:55:38.510398 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:55:38.510479 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:55:38.510542 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:55:38.510608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:55:38.510670 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:55:38.510745 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:55:38.510803 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:55:38.818732 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:55:40.103043 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:55:40.103135 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:55:40.103207 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:55:40.103275 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:55:40.103333 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:55:40.103393 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:55:40.103457 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:55:40.414040 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:55:49.624533 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:55:49.624618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:55:49.624701 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:55:49.624794 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:55:49.624866 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:55:49.624936 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:55:49.625032 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:55:49.938666 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:56:09.078422 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:56:09.078521 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:56:09.078593 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:56:09.078660 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:56:09.078732 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:56:09.078799 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:56:09.078863 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:56:09.385050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:56:10.671948 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:56:10.672032 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:56:10.672097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:56:10.672156 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:56:10.672220 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:56:10.672284 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:56:10.672349 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:56:10.975206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:56:39.638729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:56:39.638835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:56:39.638915 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:56:39.639000 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:56:39.639075 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:56:39.639159 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:56:39.639235 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:56:39.943920 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:56:41.233902 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:56:41.234005 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:56:41.234080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:56:41.234154 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:56:41.234219 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:56:41.234287 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:56:41.234356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:56:41.540291 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:56:49.745835 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:56:49.745922 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:56:49.745983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:56:49.746058 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:56:49.746123 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:56:49.746187 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:56:49.746247 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:56:50.066128 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:57:10.215879 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:57:10.216041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:57:10.216141 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:57:10.216226 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:57:10.216318 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:57:10.216405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:57:10.216502 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:57:10.526316 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:57:11.823038 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:57:11.823132 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:57:11.823203 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:57:11.823275 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:57:11.823348 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:57:11.823423 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:57:11.823491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:57:12.145193 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:57:40.786923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:57:40.787009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:57:40.787090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:57:40.787153 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:57:40.787217 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:57:40.787276 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:57:40.787334 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:57:41.100276 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:57:42.412373 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:57:42.412478 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:57:42.412544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:57:42.412612 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:57:42.412681 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:57:42.412745 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:57:42.412812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:57:42.714782 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:57:49.870001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:57:49.870080 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:57:49.870143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:57:49.870211 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:57:49.870279 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:57:49.870344 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:57:49.870404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:57:50.180546 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:58:11.360103 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:58:11.360191 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:58:11.360254 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:58:11.360322 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:58:11.360380 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:58:11.360441 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:58:11.360505 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:58:11.670435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:58:12.979045 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:58:12.979408 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:58:12.980234 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:58:12.980361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:58:12.980448 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:58:12.980539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:58:12.980622 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:58:13.287423 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:58:41.930288 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:58:41.930387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:58:41.930459 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:58:41.930531 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:58:41.930596 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:58:41.930662 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:58:41.930733 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:58:42.250261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:58:43.556743 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:58:43.556834 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:58:43.556896 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:58:43.556966 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:58:43.557025 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:58:43.557090 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:58:43.557149 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:58:43.861998 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:58:49.991438 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:58:49.991517 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:58:49.991588 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:58:49.991652 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:58:49.991736 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:58:49.991800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:58:49.991863 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:58:50.313136 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:59:12.512100 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:59:12.512201 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:59:12.512262 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:59:12.512326 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:59:12.512394 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:59:12.512472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:59:12.512530 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:59:12.816671 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:59:14.129287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:59:14.129391 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:59:14.129451 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:59:14.129516 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:59:14.129583 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:59:14.129643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:59:14.129705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:59:14.442911 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:59:43.085357 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:59:43.085455 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:59:43.085521 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:59:43.085590 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:59:43.085654 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:59:43.085727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:59:43.085788 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:59:43.394261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:59:44.705651 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:59:44.705769 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:59:44.705847 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:59:44.705924 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:59:44.706009 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:59:44.706079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:59:44.706163 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:59:45.006003 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 00:59:50.114510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 00:59:50.114613 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 00:59:50.114687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 00:59:50.114771 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 00:59:50.114844 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 00:59:50.114911 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 00:59:50.114984 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 00:59:50.420519 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:00:13.652623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:00:13.652727 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:00:13.652835 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:00:13.652915 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:00:13.653005 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:00:13.653080 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:00:13.653149 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:00:13.958087 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:00:15.267541 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:00:15.267664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:00:15.267749 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:00:15.267833 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:00:15.267914 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:00:15.267984 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:00:15.268059 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:00:15.572490 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:00:44.242462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:00:44.242579 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:00:44.242649 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:00:44.242724 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:00:44.242795 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:00:44.242863 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:00:44.242924 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:00:44.563143 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:00:45.837344 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:00:45.837437 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:00:45.837503 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:00:45.837573 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:00:45.837633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:00:45.837695 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:00:45.837765 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:00:46.138741 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:00:50.239775 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:00:50.239855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:00:50.239916 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:00:50.239991 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:00:50.240051 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:00:50.240126 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:00:50.240184 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:00:50.546332 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:01:14.823758 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:01:14.823845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:01:14.823925 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:01:14.823990 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:01:14.824067 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:01:14.824134 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:01:14.824199 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:01:15.135842 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:01:16.400640 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:01:16.400725 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:01:16.400788 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:01:16.400869 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:01:16.400927 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:01:16.400996 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:01:16.401057 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:01:16.712261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:01:45.399349 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:01:45.399453 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:01:45.399515 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:01:45.399578 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:01:45.399641 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:01:45.399696 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:01:45.399760 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:01:45.701665 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:01:46.975042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:01:46.975125 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:01:46.975185 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:01:46.975262 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:01:46.975330 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:01:46.975403 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:01:46.975469 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:01:47.280180 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:01:50.364633 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:01:50.364710 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:01:50.364788 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:01:50.364855 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:01:50.364927 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:01:50.364992 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:01:50.365055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:01:50.671583 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:02:15.969007 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:02:15.969087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:02:15.969152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:02:15.969217 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:02:15.969280 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:02:15.969344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:02:15.969401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:02:16.277316 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:02:17.546493 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:02:17.546585 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:02:17.546649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:02:17.546712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:02:17.546780 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:02:17.546842 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:02:17.546908 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:02:17.860797 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:02:46.544598 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:02:46.544705 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:02:46.544778 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:02:46.544835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:02:46.544896 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:02:46.544963 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:02:46.545029 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:02:46.854782 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:02:48.130310 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:02:48.130395 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:02:48.130491 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:02:48.130564 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:02:48.130655 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:02:48.130735 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:02:48.130809 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:02:48.437661 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:02:50.493823 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:02:50.493912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:02:50.493979 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:02:50.494043 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:02:50.494103 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:02:50.494165 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:02:50.494230 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:02:50.798318 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:03:17.122033 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:03:17.122146 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:03:17.122229 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:03:17.122312 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:03:17.122386 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:03:17.122472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:03:17.122555 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:03:17.425264 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:03:18.699300 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:03:18.699423 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:03:18.699510 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:03:18.699591 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:03:18.699662 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:03:18.699741 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:03:18.699817 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:03:18.998408 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:03:47.682865 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:03:47.682959 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:03:47.683030 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:03:47.683107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:03:47.683173 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:03:47.683248 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:03:47.683334 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:03:47.990672 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:03:49.262436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:03:49.262548 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:03:49.262611 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:03:49.262688 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:03:49.262758 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:03:49.262827 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:03:49.262883 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:03:49.578859 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:03:50.623878 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:03:50.623986 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:03:50.624080 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:03:50.624192 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:03:50.624277 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:03:50.624363 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:03:50.624447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:03:50.931542 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:04:18.252708 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:04:18.252837 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:04:18.252918 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:04:18.253004 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:04:18.253076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:04:18.253154 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:04:18.253230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:04:18.558924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:04:19.838184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:04:19.838281 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:04:19.838355 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:04:19.838424 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:04:19.838504 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:04:19.838566 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:04:19.838657 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:04:20.161480 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:04:48.823168 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:04:48.823255 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:04:48.823323 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:04:48.823385 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:04:48.823450 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:04:48.823517 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:04:48.823582 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:04:49.127734 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:04:50.433530 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:04:50.433645 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:04:50.433731 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:04:50.433796 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:04:50.433874 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:04:50.433947 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:04:50.434024 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:04:50.745368 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:04:51.003386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:04:51.003480 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:04:51.003553 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:04:51.003619 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:04:51.003683 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:04:51.003768 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:04:51.003829 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:04:51.304835 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:05:19.405331 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:05:19.405432 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:05:19.405506 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:05:19.405575 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:05:19.405646 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:05:19.405711 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:05:19.405781 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:05:19.708158 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:05:21.005969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:05:21.006071 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:05:21.006141 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:05:21.006209 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:05:21.006280 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:05:21.006341 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:05:21.006401 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:05:21.308461 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:05:49.973371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:05:49.973455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:05:49.973532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:05:49.973597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:05:49.973663 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:05:49.973731 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:05:49.973801 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:05:50.290535 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:05:50.861511 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:05:50.861593 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:05:50.861662 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:05:50.861728 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:05:50.861807 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:05:50.861870 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:05:50.861937 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:05:51.172617 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:05:51.572812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:05:51.572920 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:05:51.573018 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:05:51.573103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:05:51.573182 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:05:51.573259 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:05:51.573340 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:05:51.876858 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:06:20.556208 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:06:20.556316 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:06:20.556390 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:06:20.556460 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:06:20.556531 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:06:20.556604 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:06:20.556672 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:06:20.868686 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:06:22.154084 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:06:22.154189 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:06:22.154259 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:06:22.154329 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:06:22.154399 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:06:22.154465 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:06:22.154530 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:06:22.463338 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:06:50.993823 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:06:50.993917 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:06:50.994001 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:06:50.994085 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:06:50.994156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:06:50.994233 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:06:50.994307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:06:51.303507 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:06:51.569083 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:06:51.569187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:06:51.569263 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:06:51.569338 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:06:51.569409 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:06:51.569484 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:06:51.569548 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:06:51.882112 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:06:52.720170 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:06:52.720285 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:06:52.720367 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:06:52.720445 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:06:52.720528 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:06:52.720618 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:06:52.720693 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:06:53.023710 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:07:21.572349 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:07:21.572466 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:07:21.572549 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:07:21.572622 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:07:21.572693 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:07:21.572773 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:07:21.572840 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:07:21.890236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:07:23.285899 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:07:23.286023 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:07:23.286095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:07:23.286171 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:07:23.286245 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:07:23.286313 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:07:23.286380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:07:23.602443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:07:51.117854 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:07:51.117950 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:07:51.118038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:07:51.118110 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:07:51.118190 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:07:51.118261 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:07:51.118330 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:07:51.423766 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:07:52.165638 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:07:52.165752 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:07:52.165836 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:07:52.165909 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:07:52.165980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:07:52.166051 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:07:52.166126 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:07:52.473370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:07:53.866685 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:07:53.866786 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:07:53.866854 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:07:53.866924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:07:53.866983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:07:53.867047 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:07:53.867108 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:07:54.171875 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:08:22.730688 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:08:22.730787 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:08:22.730869 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:08:22.730964 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:08:22.731051 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:08:22.731124 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:08:22.731201 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:08:23.039823 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:08:24.433889 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:08:24.433990 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:08:24.434073 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:08:24.434167 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:08:24.434243 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:08:24.434324 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:08:24.434401 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:08:24.740778 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:08:51.247331 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:08:51.247422 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:08:51.247500 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:08:51.247576 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:08:51.247641 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:08:51.247712 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:08:51.247793 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:08:51.561562 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:08:53.301685 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:08:53.301824 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:08:53.301911 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:08:53.302004 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:08:53.302078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:08:53.302149 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:08:53.302218 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:08:53.609099 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:08:55.011549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:08:55.011645 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:08:55.011733 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:08:55.011807 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:08:55.011899 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:08:55.011982 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:08:55.012063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:08:55.315254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:09:23.868152 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:09:23.868253 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:09:23.868326 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:09:23.868399 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:09:23.868472 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:09:23.868548 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:09:23.868635 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:09:24.170267 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:09:25.569926 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:09:25.570039 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:09:25.570111 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:09:25.570183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:09:25.570257 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:09:25.570338 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:09:25.570408 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:09:25.882168 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:09:51.375483 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:09:51.375561 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:09:51.375629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:09:51.375687 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:09:51.375775 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:09:51.375837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:09:51.375895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:09:51.685803 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:09:54.438136 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:09:54.438216 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:09:54.438308 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:09:54.438375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:09:54.438443 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:09:54.438516 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:09:54.438577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:09:54.745593 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:09:56.146204 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:09:56.146283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:09:56.146352 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:09:56.146433 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:09:56.146502 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:09:56.146568 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:09:56.146634 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:09:56.460091 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:10:25.010283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:10:25.010364 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:10:25.010438 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:10:25.010500 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:10:25.010563 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:10:25.010623 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:10:25.010689 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:10:25.321632 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:10:26.736575 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:10:26.736657 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:10:26.736737 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:10:26.736815 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:10:26.736885 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:10:26.736947 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:10:26.737017 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:10:27.040356 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:10:51.502083 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:10:51.503224 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:10:51.503762 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:10:51.504149 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:10:51.504307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:10:51.504484 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:10:51.504642 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:10:51.811265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:10:55.584578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:10:55.584689 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:10:55.584784 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:10:55.584870 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:10:55.584957 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:10:55.585032 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:10:55.585108 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:10:55.882262 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:10:57.303505 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:10:57.303614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:10:57.303699 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:10:57.303777 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:10:57.303853 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:10:57.303922 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:10:57.304000 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:10:57.604602 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:11:26.134158 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:11:26.134269 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:11:26.134352 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:11:26.134419 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:11:26.134492 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:11:26.134569 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:11:26.134649 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:11:26.439459 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:11:27.859475 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:11:27.859595 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:11:27.859671 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:11:27.859764 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:11:27.859841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:11:27.859913 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:11:27.859994 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:11:28.170061 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:11:51.627977 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:11:51.628091 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:11:51.628164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:11:51.628245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:11:51.628313 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:11:51.628394 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:11:51.628465 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:11:51.932404 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:11:56.708369 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:11:56.708481 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:11:56.708565 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:11:56.708657 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:11:56.708746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:11:56.708821 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:11:56.708916 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:11:57.011698 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:11:58.431580 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:11:58.431683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:11:58.431779 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:11:58.431860 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:11:58.431985 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:11:58.432085 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:11:58.432186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:11:58.739107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:12:27.277224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:12:27.277325 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:12:27.277397 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:12:27.277466 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:12:27.277537 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:12:27.277606 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:12:27.277672 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:12:27.593420 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:12:29.006149 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:12:29.006244 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:12:29.006310 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:12:29.006370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:12:29.006431 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:12:29.006497 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:12:29.006563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:12:29.316461 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:12:51.755789 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:12:51.755890 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:12:51.755968 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:12:51.756049 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:12:51.756132 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:12:51.756213 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:12:51.756287 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:12:52.071298 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:12:57.856003 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:12:57.856103 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:12:57.856184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:12:57.856264 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:12:57.856347 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:12:57.856419 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:12:57.856495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:12:58.175446 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:12:59.580531 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:12:59.580639 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:12:59.580715 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:12:59.580829 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:12:59.580902 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:12:59.580982 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:12:59.581051 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:12:59.886127 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:13:28.437773 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:13:28.437877 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:13:28.437954 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:13:28.438026 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:13:28.438107 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:13:28.438168 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:13:28.438234 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:13:28.743029 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:13:30.148674 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:13:30.148778 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:13:30.148871 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:13:30.148955 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:13:30.149059 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:13:30.149143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:13:30.149225 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:13:30.456391 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:13:51.882957 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:13:51.883052 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:13:51.883132 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:13:51.883200 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:13:51.883291 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:13:51.883376 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:13:51.883456 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:13:52.238216 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:13:59.013346 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:13:59.013457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:13:59.013530 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:13:59.013613 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:13:59.013690 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:13:59.013775 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:13:59.013848 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:13:59.323786 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:14:00.718543 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:14:00.718641 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:14:00.718730 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:14:00.718815 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:14:00.718891 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:14:00.718963 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:14:00.719041 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:14:01.025041 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:14:29.586620 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:14:29.586742 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:14:29.586824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:14:29.586895 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:14:29.586965 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:14:29.587032 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:14:29.587107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:14:29.894733 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:14:31.290409 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:14:31.290515 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:14:31.290594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:14:31.290676 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:14:31.290758 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:14:31.290838 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:14:31.290910 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:14:31.608748 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:14:52.010723 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:14:52.010814 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:14:52.010889 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:14:52.010967 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:14:52.011044 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:14:52.011108 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:14:52.011181 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:14:52.329821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:15:00.159340 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:15:00.159435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:15:00.159502 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:15:00.159569 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:15:00.159629 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:15:00.159712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:15:00.159781 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:15:00.479405 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:15:01.870402 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:15:01.870488 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:15:01.870559 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:15:01.870621 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:15:01.870693 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:15:01.870759 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:15:01.870827 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:15:02.189323 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:15:30.761732 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:15:30.762770 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:15:30.762883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:15:30.762978 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:15:30.763062 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:15:30.763145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:15:30.763249 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:15:31.067219 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:15:32.451517 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:15:32.451609 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:15:32.451687 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:15:32.451771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:15:32.451854 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:15:32.451932 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:15:32.452005 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:15:32.756201 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:15:52.140115 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:15:52.140233 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:15:52.140316 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:15:52.140396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:15:52.140472 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:15:52.140547 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:15:52.140619 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:15:52.452287 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:16:01.328666 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:16:01.328769 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:16:01.328857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:16:01.328941 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:16:01.329027 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:16:01.329095 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:16:01.329169 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:16:01.633875 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:16:03.016856 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:16:03.016966 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:16:03.017041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:16:03.017116 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:16:03.017197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:16:03.017280 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:16:03.017355 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:16:03.319310 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:16:31.901368 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:16:31.901485 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:16:31.901573 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:16:31.901653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:16:31.901746 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:16:31.901827 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:16:31.901920 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:16:32.238272 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:16:33.574463 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:16:33.574589 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:16:33.574703 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:16:33.574793 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:16:33.574895 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:16:33.575915 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:16:33.576206 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:16:33.881343 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:16:52.271025 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:16:52.271126 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:16:52.271208 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:16:52.271278 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:16:52.271356 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:16:52.271427 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:16:52.271503 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:16:52.590007 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:17:02.498189 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:17:02.498277 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:17:02.498342 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:17:02.498402 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:17:02.498476 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:17:02.498542 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:17:02.498611 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:17:02.794960 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:17:04.142855 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:17:04.142954 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:17:04.143024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:17:04.143094 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:17:04.143178 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:17:04.143243 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:17:04.143313 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:17:04.453378 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:17:33.052972 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:17:33.053072 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:17:33.053146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:17:33.053216 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:17:33.053287 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:17:33.053348 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:17:33.053420 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:17:33.362336 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:17:34.712367 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:17:34.712461 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:17:34.712541 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:17:34.712619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:17:34.712699 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:17:34.712796 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:17:34.712875 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:17:35.018881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:17:52.402288 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:17:52.402386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:17:52.402464 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:17:52.402536 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:17:52.402609 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:17:52.402683 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:17:52.402769 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:17:52.699179 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:18:03.632721 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:18:03.632808 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:18:03.632887 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:18:03.632957 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:18:03.633018 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:18:03.633090 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:18:03.633156 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:18:03.940179 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:18:05.281509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:18:05.281606 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:18:05.281682 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:18:05.281753 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:18:05.281826 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:18:05.281888 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:18:05.281965 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:18:05.597416 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:18:34.202764 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:18:34.202864 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:18:34.202929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:18:34.202993 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:18:34.203070 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:18:34.203136 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:18:34.203194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:18:34.512628 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:18:35.862588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:18:35.862705 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:18:35.862790 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:18:35.862871 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:18:35.862947 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:18:35.863021 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:18:35.863099 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:18:36.169304 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:18:52.537778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:18:52.537871 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:18:52.537946 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:18:52.538024 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:18:52.538099 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:18:52.538176 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:18:52.538245 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:18:52.845553 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:19:04.781550 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:19:04.781663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:19:04.781756 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:19:04.781851 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:19:04.781931 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:19:04.782011 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:19:04.782096 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:19:05.088544 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:19:06.435350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:19:06.435452 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:19:06.435522 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:19:06.435594 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:19:06.435666 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:19:06.435739 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:19:06.435816 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:19:06.738081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:19:35.357639 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:19:35.357741 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:19:35.357845 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:19:35.357923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:19:35.358002 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:19:35.358082 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:19:35.358161 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:19:35.660210 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:19:36.999931 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:19:37.000016 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:19:37.000103 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:19:37.000177 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:19:37.000255 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:19:37.000333 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:19:37.000413 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:19:37.306085 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:19:52.668016 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:19:52.668109 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:19:52.668183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:19:52.668268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:19:52.668342 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:19:52.668428 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:19:52.668504 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:19:52.976266 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:20:05.922115 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:20:05.922235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:20:05.922313 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:20:05.922397 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:20:05.922474 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:20:05.922556 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:20:05.922636 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:20:06.224255 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:20:07.570512 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:20:07.570602 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:20:07.570675 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:20:07.570767 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:20:07.570836 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:20:07.570906 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:20:07.570979 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:20:07.876255 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:20:36.484087 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:20:36.484193 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:20:36.484269 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:20:36.484335 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:20:36.484405 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:20:36.484468 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:20:36.484547 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:20:36.789092 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:20:38.137499 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:20:38.137598 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:20:38.137666 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:20:38.137733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:20:38.137806 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:20:38.137864 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:20:38.137932 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:20:38.434743 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:20:52.798606 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:20:52.798690 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:20:52.798783 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:20:52.798852 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:20:52.798915 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:20:52.798981 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:20:52.799046 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:20:53.107326 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:21:07.047045 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:21:07.047143 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:21:07.047213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:21:07.047281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:21:07.047348 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:21:07.047410 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:21:07.047474 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:21:07.355526 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:21:08.699922 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:21:08.700039 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:21:08.700123 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:21:08.700205 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:21:08.700287 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:21:08.700358 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:21:08.700434 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:21:09.006276 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:21:37.619372 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:21:37.619477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:21:37.619548 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:21:37.619619 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:21:37.619691 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:21:37.619771 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:21:37.619843 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:21:37.918785 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:21:39.277425 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:21:39.277514 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:21:39.277583 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:21:39.277648 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:21:39.277714 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:21:39.277792 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:21:39.277856 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:21:39.586537 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:21:52.934619 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:21:52.934699 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:21:52.934768 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:21:52.934845 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:21:52.934911 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:21:52.934978 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:21:52.935040 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:21:53.240661 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:22:08.180551 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:22:08.180651 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:22:08.180711 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:22:08.180799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:22:08.180862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:22:08.180933 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:22:08.180994 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:22:08.491207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:22:09.846031 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:22:09.846120 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:22:09.846186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:22:09.846252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:22:09.846323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:22:09.846387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:22:09.846450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:22:10.152448 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:22:38.752528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:22:38.752652 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:22:38.752739 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:22:38.752828 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:22:38.752902 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:22:38.752981 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:22:38.753059 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:22:39.055447 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:22:40.409966 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:22:40.410076 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:22:40.410150 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:22:40.410218 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:22:40.410294 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:22:40.410370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:22:40.410450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:22:40.714320 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:22:53.060357 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:22:53.060440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:22:53.060503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:22:53.060579 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:22:53.060646 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:22:53.060709 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:22:53.060779 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:22:53.358846 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:23:09.318275 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:23:09.318365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:23:09.318445 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:23:09.318503 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:23:09.318561 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:23:09.318653 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:23:09.318709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:23:09.622044 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:23:10.971205 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:23:10.971281 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:23:10.971358 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:23:10.971424 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:23:10.971483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:23:10.971543 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:23:10.971613 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:23:11.271093 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:23:39.880621 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:23:39.881222 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:23:39.881947 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:23:39.882340 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:23:39.883187 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:23:39.883299 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:23:39.883377 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:23:40.214996 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:23:41.533438 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:23:41.533526 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:23:41.533592 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:23:41.533663 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:23:41.533737 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:23:41.533804 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:23:41.533872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:23:41.841690 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:23:53.190041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:23:53.190118 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:23:53.190188 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:23:53.190257 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:23:53.190323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:23:53.190383 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:23:53.190451 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:23:53.495668 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:24:10.481451 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:24:10.481535 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:24:10.481603 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:24:10.481678 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:24:10.481756 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:24:10.481819 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:24:10.481881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:24:10.781902 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:24:12.104967 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:24:12.105073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:24:12.105170 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:24:12.105250 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:24:12.105348 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:24:12.105430 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:24:12.105520 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:24:12.420220 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:24:41.038457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:24:41.038564 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:24:41.038635 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:24:41.038711 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:24:41.038786 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:24:41.038864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:24:41.038935 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:24:41.342698 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:24:42.679642 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:24:42.679755 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:24:42.679834 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:24:42.679908 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:24:42.681092 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:24:42.681546 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:24:42.682105 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:24:42.986094 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:24:53.319084 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:24:53.319176 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:24:53.319273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:24:53.319350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:24:53.319430 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:24:53.319509 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:24:53.319588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:24:53.623967 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:25:11.612312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:25:11.612440 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:25:11.612519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:25:11.612593 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:25:11.612677 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:25:11.612763 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:25:11.612845 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:25:11.921809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:25:13.245193 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:25:13.245294 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:25:13.245368 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:25:13.245446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:25:13.245517 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:25:13.245597 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:25:13.245670 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:25:13.551166 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:25:42.206974 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:25:42.207077 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:25:42.207159 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:25:42.207244 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:25:42.207315 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:25:42.207392 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:25:42.207472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:25:42.508979 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:25:43.814618 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:25:43.814728 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:25:43.814816 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:25:43.814892 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:25:43.814973 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:25:43.815052 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:25:43.815132 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:25:44.126985 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:25:53.447900 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:25:53.447999 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:25:53.448099 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:25:53.448195 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:25:53.448292 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:25:53.448385 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:25:53.448472 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:25:53.751914 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:26:12.764134 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:26:12.764252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:26:12.764334 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:26:12.764413 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:26:12.764502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:26:12.764582 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:26:12.764664 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:26:13.071636 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:26:14.397667 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:26:14.397792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:26:14.397871 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:26:14.397960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:26:14.398035 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:26:14.398115 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:26:14.398190 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:26:14.700105 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:26:43.337058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:26:43.337158 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:26:43.337232 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:26:43.337308 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:26:43.337392 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:26:43.337473 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:26:43.337537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:26:43.640474 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:26:44.959630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:26:44.959733 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:26:44.959813 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:26:44.959891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:26:44.959972 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:26:44.960052 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:26:44.960135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:26:45.269109 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:26:53.573153 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:26:53.573268 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:26:53.573344 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:26:53.573427 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:26:53.573499 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:26:53.573564 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:26:53.573633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:26:53.879793 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:27:13.900163 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:27:13.900269 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:27:13.900344 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:27:13.900425 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:27:13.901298 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:27:13.901677 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:27:13.901882 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:27:14.221513 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:27:15.534387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:27:15.534503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:27:15.534589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:27:15.534671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:27:15.534751 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:27:15.534823 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:27:15.534901 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:27:15.842116 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:27:44.487421 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:27:44.487534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:27:44.487624 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:27:44.487703 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:27:44.487797 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:27:44.487873 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:27:44.487950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:27:44.791226 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:27:46.108961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:27:46.109073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:27:46.109149 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:27:46.109234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:27:46.109300 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:27:46.109377 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:27:46.109454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:27:46.416947 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:27:53.701321 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:27:53.701454 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:27:53.701541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:27:53.701614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:27:53.701691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:27:53.701782 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:27:53.701864 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:27:54.013363 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:28:15.050457 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:28:15.050574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:28:15.050648 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:28:15.050733 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:28:15.050811 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:28:15.050880 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:28:15.050948 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:28:15.352895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:28:16.676748 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:28:16.676843 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:28:16.676916 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:28:16.676988 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:28:16.677062 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:28:16.677127 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:28:16.677204 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:28:16.991261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:28:45.617407 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:28:45.617524 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:28:45.617622 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:28:45.617714 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:28:45.617817 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:28:45.617928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:28:45.618018 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:28:45.921854 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:28:47.253645 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:28:47.253747 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:28:47.253824 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:28:47.253893 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:28:47.253970 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:28:47.254037 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:28:47.254129 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:28:47.557377 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:28:53.829603 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:28:53.829714 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:28:53.829793 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:28:53.829881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:28:53.829958 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:28:53.830053 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:28:53.830115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:28:54.134988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:29:16.189818 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:29:16.189907 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:29:16.189989 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:29:16.190065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:29:16.190150 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:29:16.190223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:29:16.190297 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:29:16.507922 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:29:17.825787 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:29:17.825886 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:29:17.825969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:29:17.826046 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:29:17.826116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:29:17.826214 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:29:17.826279 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:29:18.133691 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:29:46.768686 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:29:46.768776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:29:46.768852 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:29:46.768924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:29:46.768999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:29:46.769066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:29:46.769132 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:29:47.082905 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:29:48.391917 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:29:48.392003 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:29:48.392066 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:29:48.392154 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:29:48.392215 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:29:48.392281 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:29:48.392349 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:29:48.708104 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:29:53.954411 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:29:53.954502 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:29:53.954574 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:29:53.954636 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:29:53.954708 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:29:53.954774 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:29:53.954842 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:29:54.259800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:30:17.341068 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:30:17.341157 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:30:17.341239 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:30:17.341295 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:30:17.341360 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:30:17.341415 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:30:17.341474 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:30:17.647756 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:30:18.973027 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:30:18.973136 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:30:18.973219 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:30:18.973295 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:30:18.973376 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:30:18.973467 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:30:18.973542 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:30:19.278416 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:30:47.925911 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:30:47.925995 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:30:47.926075 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:30:47.926148 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:30:47.926222 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:30:47.926289 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:30:47.926360 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:30:48.232209 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:30:49.543677 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:30:49.543779 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:30:49.543858 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:30:49.543936 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:30:49.544011 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:30:49.544082 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:30:49.544155 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:30:49.857881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:30:54.079861 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:30:54.079952 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:30:54.080026 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:30:54.080106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:30:54.080176 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:30:54.080249 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:30:54.080315 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:30:54.387524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:31:18.492599 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:31:18.492695 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:31:18.492770 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:31:18.492835 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:31:18.492890 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:31:18.492953 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:31:18.493016 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:31:18.805027 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:31:20.134545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:31:20.134630 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:31:20.134708 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:31:20.134791 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:31:20.134855 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:31:20.134914 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:31:20.134978 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:31:20.436147 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:31:49.064856 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:31:49.064967 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:31:49.065036 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:31:49.065109 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:31:49.065179 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:31:49.065239 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:31:49.065301 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:31:49.375743 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:31:50.692194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:31:50.692287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:31:50.692358 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:31:50.692433 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:31:50.692502 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:31:50.692566 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:31:50.692637 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:31:51.003033 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:31:54.207908 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:31:54.207988 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:31:54.208055 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:31:54.208119 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:31:54.208187 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:31:54.208256 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:31:54.208327 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:31:54.514556 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:32:19.643299 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:32:19.643428 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:32:19.643507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:32:19.643569 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:32:19.643639 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:32:19.643706 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:32:19.643773 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:32:19.956067 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:32:21.264962 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:32:21.265065 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:32:21.265140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:32:21.265210 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:32:21.265269 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:32:21.265341 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:32:21.265406 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:32:21.577595 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:32:50.218741 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:32:50.218831 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:32:50.218901 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:32:50.218969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:32:50.219029 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:32:50.219089 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:32:50.219162 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:32:50.527389 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:32:51.840252 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:32:51.840615 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:32:51.841370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:32:51.841691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:32:51.842480 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:32:51.842572 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:32:51.842670 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:32:52.149790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:32:54.339143 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:32:54.339224 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:32:54.339291 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:32:54.339361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:32:54.339428 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:32:54.339493 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:32:54.339562 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:32:54.646969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:33:20.789677 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:33:20.789806 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:33:20.789905 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:33:20.789987 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:33:20.790074 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:33:20.790152 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:33:20.790237 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:33:21.107342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:33:22.416959 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:33:22.417067 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:33:22.417138 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:33:22.417214 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:33:22.417287 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:33:22.417360 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:33:22.417440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:33:22.720047 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:33:51.366517 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:33:51.366632 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:33:51.366714 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:33:51.366803 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:33:51.366875 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:33:51.366971 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:33:51.367050 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:33:51.672408 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:33:52.984311 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:33:52.984426 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:33:52.984499 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:33:52.984573 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:33:52.984638 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:33:52.984715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:33:52.984805 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:33:53.294409 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:33:54.466781 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:33:54.468089 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:33:54.468258 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:33:54.468330 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:33:54.468408 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:33:54.468490 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:33:54.468560 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:33:54.778341 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:34:21.937622 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:34:21.937711 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:34:21.937785 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:34:21.937872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:34:21.937949 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:34:21.938013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:34:21.938077 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:34:22.252834 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:34:23.560580 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:34:23.560692 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:34:23.560771 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:34:23.560832 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:34:23.560895 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:34:23.560965 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:34:23.561031 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:34:23.864894 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:34:52.514110 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:34:52.514205 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:34:52.514278 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:34:52.514348 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:34:52.514409 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:34:52.514468 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:34:52.514536 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:34:52.817486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:34:54.126005 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:34:54.126085 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:34:54.126144 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:34:54.126206 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:34:54.126286 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:34:54.126350 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:34:54.126405 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:34:54.438030 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:34:54.704006 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:34:54.704119 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:34:54.704196 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:34:54.704257 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:34:54.704333 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:34:54.704408 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:34:54.704479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:34:55.010347 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:35:23.088338 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:35:23.088489 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:35:23.088584 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:35:23.088692 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:35:23.088790 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:35:23.088881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:35:23.088960 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:35:23.396148 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:35:24.704806 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:35:24.704904 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:35:24.704980 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:35:24.705049 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:35:24.705125 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:35:24.705195 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:35:24.705271 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:35:25.007383 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:35:53.660677 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:35:53.660769 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:35:53.660856 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:35:53.660920 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:35:53.660980 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:35:53.661038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:35:53.661112 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:35:53.959641 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:35:54.708251 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:35:54.708323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:35:54.708387 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:35:54.708455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:35:54.708517 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:35:54.708573 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:35:54.708637 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:35:55.023451 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:35:55.290110 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:35:55.290194 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:35:55.290256 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:35:55.290323 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:35:55.290386 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:35:55.290452 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:35:55.290507 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:35:55.603815 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:36:24.237167 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:36:24.237631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:36:24.237867 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:36:24.238837 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:36:24.238932 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:36:24.239002 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:36:24.239073 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:36:24.538765 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:36:25.860963 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:36:25.861069 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:36:25.861146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:36:25.861218 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:36:25.861290 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:36:25.861354 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:36:25.861417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:36:26.157801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:36:54.800170 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:36:54.800263 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:36:54.800332 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:36:54.800395 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:36:54.800459 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:36:54.800524 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:36:54.800583 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:36:55.112488 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:36:55.382559 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:36:55.382668 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:36:55.382747 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:36:55.382826 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:36:55.382891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:36:55.382964 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:36:55.383032 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:36:55.687959 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:36:56.418054 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:36:56.418144 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:36:56.418206 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:36:56.418280 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:36:56.418344 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:36:56.418406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:36:56.418471 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:36:56.721059 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:37:25.380704 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:37:25.380816 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:37:25.380889 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:37:25.380983 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:37:25.381065 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:37:25.381153 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:37:25.381229 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:37:25.687446 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:37:26.983528 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:37:26.983641 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:37:26.983747 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:37:26.983821 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:37:26.983899 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:37:26.983979 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:37:26.984053 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:37:27.283710 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:37:54.958645 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:37:54.958731 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:37:54.958804 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:37:54.958876 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:37:54.958944 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:37:54.959013 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:37:54.959079 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:37:55.273774 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:37:55.939467 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:37:55.939561 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:37:55.939631 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:37:55.939695 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:37:55.939764 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:37:55.939825 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:37:55.939890 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:37:56.244175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:37:57.537432 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:37:57.537512 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:37:57.537582 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:37:57.537647 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:37:57.537709 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:37:57.537780 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:37:57.537845 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:37:57.839424 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:38:26.522348 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:38:26.522432 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:38:26.522492 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:38:26.522558 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:38:26.522621 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:38:26.522685 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:38:26.522751 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:38:26.825051 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:38:28.098528 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:38:28.098603 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:38:28.098680 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:38:28.098751 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:38:28.098814 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:38:28.098881 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:38:28.098943 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:38:28.408126 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:38:55.081695 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:38:55.081782 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:38:55.081861 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:38:55.081928 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:38:55.081992 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:38:55.082055 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:38:55.082122 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:38:55.390576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:38:57.086213 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:38:57.086295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:38:57.086360 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:38:57.086423 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:38:57.086491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:38:57.086551 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:38:57.086615 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:38:57.391111 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:38:58.670897 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:38:58.670992 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:38:58.671057 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:38:58.671127 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:38:58.671182 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:38:58.671248 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:38:58.671312 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:38:58.983213 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:39:27.648729 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:39:27.648813 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:39:27.648878 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:39:27.648947 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:39:27.649017 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:39:27.649079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:39:27.649146 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:39:27.957890 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:39:29.246425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:39:29.246546 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:39:29.246632 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:39:29.246712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:39:29.246795 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:39:29.246873 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:39:29.246952 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:39:29.555191 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:39:55.205133 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:39:55.205238 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:39:55.205319 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:39:55.205409 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:39:55.205499 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:39:55.205575 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:39:55.205673 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:39:55.516066 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:39:58.217627 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:39:58.217742 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:39:58.217817 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:39:58.217891 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:39:58.217954 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:39:58.218026 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:39:58.218094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:39:58.526576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:39:59.813899 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:39:59.814009 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:39:59.814093 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:39:59.814162 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:39:59.814231 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:39:59.814298 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:39:59.814376 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:40:00.126135 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:40:28.789114 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:40:28.789196 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:40:28.789263 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:40:28.789335 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:40:28.789400 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:40:28.789466 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:40:28.789528 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:40:29.102729 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:40:30.392352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:40:30.392437 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:40:30.392508 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:40:30.392574 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:40:30.392635 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:40:30.392703 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:40:30.392768 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:40:30.693865 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:40:55.324784 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:40:55.324876 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:40:55.324975 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:40:55.325047 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:40:55.325122 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:40:55.325189 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:40:55.325273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:40:55.635802 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:40:59.372570 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:40:59.372677 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:40:59.372773 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:40:59.372851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:40:59.372927 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:40:59.373009 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:40:59.373073 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:40:59.674281 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:41:00.950400 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:41:00.950494 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:41:00.950569 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:41:00.950650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:41:00.950738 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:41:00.950817 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:41:00.950896 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:41:01.253479 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:41:29.933303 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:41:29.933419 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:41:29.933509 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:41:29.933589 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:41:29.933656 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:41:29.933729 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:41:29.933799 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:41:30.237896 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:41:31.513454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:41:31.513572 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:41:31.513670 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:41:31.513766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:41:31.513861 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:41:31.513946 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:41:31.514034 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:41:31.822941 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:41:55.447503 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:41:55.447595 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:41:55.447673 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:41:55.447761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:41:55.447828 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:41:55.447900 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:41:55.447978 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:41:55.758582 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:42:00.502380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:42:00.502470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:42:00.502534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:42:00.502602 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:42:00.502666 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:42:00.502740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:42:00.502809 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:42:00.805312 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:42:02.095144 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:42:02.095242 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:42:02.095325 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:42:02.095400 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:42:02.095470 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:42:02.095550 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:42:02.095604 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:42:02.402330 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:42:31.062446 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:42:31.062531 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:42:31.062609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:42:31.062675 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:42:31.062744 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:42:31.062812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:42:31.062876 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:42:31.370501 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:42:32.673371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:42:32.673480 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:42:32.673559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:42:32.673631 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:42:32.673693 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:42:32.673771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:42:32.673836 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:42:32.983501 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:42:55.573168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:42:55.573245 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:42:55.573316 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:42:55.573379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:42:55.573445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:42:55.573510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:42:55.573572 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:42:55.877747 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:43:01.633004 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:43:01.633107 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:43:01.633182 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:43:01.633247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:43:01.633308 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:43:01.633378 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:43:01.633439 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:43:01.938041 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:43:03.248508 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:43:03.248592 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:43:03.248675 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:43:03.248743 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:43:03.248813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:43:03.248875 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:43:03.248942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:43:03.555891 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:43:32.198959 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:43:32.199097 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:43:32.199171 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:43:32.199250 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:43:32.199336 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:43:32.199411 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:43:32.199479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:43:32.504808 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:43:33.816848 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:43:33.816950 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:43:33.817014 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:43:33.817081 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:43:33.817152 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:43:33.817217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:43:33.817278 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:43:34.122318 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:43:55.689772 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:43:55.689859 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:43:55.689928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:43:55.689990 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:43:55.690055 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:43:55.690118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:43:55.690184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:43:55.994863 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:44:02.764493 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:44:02.764576 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:44:02.764643 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:44:02.764728 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:44:02.764812 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:44:02.764878 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:44:02.764936 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:44:03.069229 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:44:04.394292 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:44:04.394373 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:44:04.394437 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:44:04.394503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:44:04.394561 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:44:04.394626 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:44:04.394692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:44:04.702649 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:44:33.327942 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:44:33.328047 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:44:33.328131 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:44:33.328205 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:44:33.328265 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:44:33.328329 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:44:33.328388 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:44:33.632988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:44:34.973511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:44:34.973616 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:44:34.973689 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:44:34.973769 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:44:34.973839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:44:34.973904 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:44:34.973977 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:44:35.278580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:44:55.813028 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:44:55.813107 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:44:55.813180 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:44:55.813248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:44:55.813319 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:44:55.813386 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:44:55.813454 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:44:56.119908 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 01:45:03.894610 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:45:03.894724 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:45:03.894793 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:45:03.894858 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:45:03.894927 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:45:03.894989 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:45:03.895057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:45:04.198734 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:45:05.539183 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:45:05.539265 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:45:05.539329 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:45:05.539392 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:45:05.539459 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:45:05.539519 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:45:05.539584 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:45:05.846144 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:45:34.458438 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:45:34.458547 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:45:34.458617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:45:34.458683 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:45:34.458753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:45:34.458819 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:45:34.458880 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:45:34.761749 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:45:36.108875 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:45:36.109002 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:45:36.109088 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:45:36.109168 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:45:36.109245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:45:36.109329 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:45:36.109401 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:45:36.412826 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:45:55.933614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:45:55.933708 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:45:55.933784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:45:55.933857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:45:55.933941 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:45:55.934012 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:45:55.934084 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:45:56.240780 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:46:05.032241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:46:05.032330 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:46:05.032397 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:46:05.032461 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:46:05.032523 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:46:05.032594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:46:05.032659 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:46:05.337404 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:46:06.671210 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:46:06.671295 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:46:06.671364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:46:06.671429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:46:06.671497 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:46:06.671562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:46:06.671629 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:46:06.973754 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:46:35.601430 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:46:35.601524 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:46:35.601606 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:46:35.601693 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:46:35.601777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:46:35.601852 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:46:35.601948 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:46:35.903576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:46:37.233373 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:46:37.233464 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:46:37.233545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:46:37.233635 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:46:37.233711 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:46:37.233809 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:46:37.233886 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:46:37.552755 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:46:56.055440 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:46:56.055549 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:46:56.055636 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:46:56.055713 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:46:56.055796 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:46:56.055872 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:46:56.055957 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:46:56.363390 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:47:06.164867 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:47:06.164970 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:47:06.165042 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:47:06.165111 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:47:06.165182 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:47:06.165261 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:47:06.165332 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:47:06.465763 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:47:07.815381 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:47:07.815467 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:47:07.815542 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:47:07.815610 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:47:07.815691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:47:07.815764 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:47:07.815833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:47:08.117001 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:47:36.731057 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:47:36.731155 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:47:36.731237 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:47:36.731306 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:47:36.731367 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:47:36.731445 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:47:36.731515 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:47:37.042075 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:47:38.376660 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:47:38.376779 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:47:38.376873 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:47:38.376959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:47:38.377041 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:47:38.377116 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:47:38.377191 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:47:38.683336 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:47:56.183392 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:47:56.183673 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:47:56.184018 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:47:56.184562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:47:56.185587 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:47:56.185752 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:47:56.185885 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:47:56.494407 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:48:07.301958 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:48:07.302052 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:48:07.302116 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:48:07.302194 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:48:07.302260 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:48:07.302337 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:48:07.302408 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:48:07.607230 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:48:08.946869 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:48:08.946956 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:48:08.947035 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:48:08.947098 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:48:08.947162 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:48:08.947222 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:48:08.947285 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:48:09.269449 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:48:37.872003 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:48:37.872103 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:48:37.872186 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:48:37.872253 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:48:37.872316 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:48:37.872382 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:48:37.872445 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:48:38.174591 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:48:39.530313 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:48:39.530398 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:48:39.530461 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:48:39.530527 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:48:39.530592 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:48:39.530655 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:48:39.530713 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:48:39.840625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:48:56.305033 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:48:56.305120 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:48:56.305186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:48:56.305251 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:48:56.305320 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:48:56.305385 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:48:56.305446 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:48:56.613187 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:49:08.437958 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:49:08.438042 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:49:08.438132 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:49:08.438194 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:49:08.438264 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:49:08.438323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:49:08.438403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:49:08.755168 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:49:10.123715 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:49:10.123801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:49:10.123875 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:49:10.123951 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:49:10.124017 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:49:10.124081 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:49:10.124143 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:49:10.425317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:49:39.020135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:49:39.020216 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:49:39.020280 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:49:39.020351 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:49:39.020413 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:49:39.020476 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:49:39.020540 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:49:39.329507 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:49:40.682830 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:49:40.682916 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:49:40.682988 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:49:40.683050 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:49:40.683118 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:49:40.683182 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:49:40.683252 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:49:40.993031 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:49:56.430136 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:49:56.430217 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:49:56.430283 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:49:56.430350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:49:56.430419 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:49:56.430482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:49:56.430545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:49:56.744438 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:50:09.597951 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:50:09.598070 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:50:09.598151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:50:09.598226 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:50:09.598303 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:50:09.598368 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:50:09.598442 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:50:09.905932 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:50:11.263729 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:50:11.263841 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:50:11.263945 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:50:11.264036 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:50:11.264130 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:50:11.264240 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:50:11.264326 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:50:11.583713 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:50:40.170050 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:50:40.170138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:50:40.170210 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:50:40.170278 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:50:40.170345 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:50:40.170406 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:50:40.170472 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:50:40.478758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:50:41.848143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:50:41.848232 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:50:41.848308 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:50:41.848381 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:50:41.848443 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:50:41.848511 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:50:41.848582 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:50:42.160963 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:50:56.553001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:50:56.553074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:50:56.553136 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:50:56.553201 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:50:56.553264 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:50:56.553330 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:50:56.553396 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:50:56.861310 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:51:10.743019 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:51:10.743123 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:51:10.743220 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:51:10.743295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:51:10.743373 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:51:10.743447 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:51:10.743525 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:51:11.056944 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:51:12.420833 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:51:12.420935 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:51:12.421023 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:51:12.421111 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:51:12.421205 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:51:12.421278 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:51:12.421358 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:51:12.726028 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:51:41.322059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:51:41.322165 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:51:41.322241 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:51:41.322329 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:51:41.322406 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:51:41.322488 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:51:41.322563 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:51:41.639085 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:51:42.991323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:51:42.991449 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:51:42.991530 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:51:42.991607 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:51:42.991682 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:51:42.991771 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:51:42.991864 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:51:43.293321 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:51:56.676819 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:51:56.676907 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:51:56.676985 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:51:56.677064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:51:56.677137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:51:56.677206 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:51:56.677281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:51:56.987156 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:52:11.912684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:52:11.912797 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:52:11.912862 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:52:11.912930 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:52:11.912993 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:52:11.913058 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:52:11.913118 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:52:12.230959 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:52:13.549402 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:52:13.549518 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:52:13.549600 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:52:13.549680 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:52:13.549766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:52:13.549846 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:52:13.549917 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:52:13.849713 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:52:42.497002 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:52:42.497100 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:52:42.497173 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:52:42.497250 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:52:42.497322 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:52:42.498518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:52:42.498916 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:52:42.810328 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:52:44.111296 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:52:44.111393 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:52:44.111474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:52:44.111550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:52:44.111632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:52:44.111703 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:52:44.111792 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:52:44.428436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:52:56.802531 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:52:56.802624 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:52:56.802702 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:52:56.802813 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:52:56.802892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:52:56.802973 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:52:56.803064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:52:57.107275 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:53:13.067193 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:53:13.067293 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:53:13.067365 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:53:13.067431 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:53:13.067506 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:53:13.067579 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:53:13.067649 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:53:13.374086 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:53:14.689460 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:53:14.689556 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:53:14.689630 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:53:14.689695 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:53:14.689772 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:53:14.689840 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:53:14.689909 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:53:14.997312 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:53:43.643230 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:53:43.643311 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:53:43.643381 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:53:43.643450 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:53:43.643512 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:53:43.643577 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:53:43.643644 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:53:43.964129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:53:45.261040 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:53:45.261145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:53:45.261213 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:53:45.261279 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:53:45.261342 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:53:45.261403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:53:45.261464 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:53:45.577668 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:53:56.923575 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:53:56.923669 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:53:56.923750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:53:56.923814 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:53:56.923884 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:53:56.923949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:53:56.924013 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:53:57.230949 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:54:14.236385 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:54:14.236475 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:54:14.236537 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:54:14.236601 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:54:14.236660 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:54:14.236733 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:54:14.236796 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:54:14.542936 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:54:15.839684 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:54:15.839779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:54:15.839858 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:54:15.839923 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:54:15.839986 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:54:15.840052 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:54:15.840111 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:54:16.142835 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:54:44.810294 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:54:44.810377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:54:44.810452 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:54:44.810520 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:54:44.810580 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:54:44.810644 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:54:44.810702 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:54:45.112162 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:54:46.403358 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:54:46.403436 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:54:46.403513 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:54:46.403578 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:54:46.403640 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:54:46.403701 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:54:46.403778 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:54:46.709590 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:54:57.044710 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:54:57.044792 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:54:57.044860 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:54:57.044927 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:54:57.044993 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:54:57.045053 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:54:57.045117 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:54:57.353994 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:55:15.376671 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:55:15.376775 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:55:15.376842 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:55:15.376915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:55:15.376980 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:55:15.377043 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:55:15.377104 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:55:15.683543 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:55:16.966938 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:55:16.967047 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:55:16.967105 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:55:16.967170 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:55:16.967233 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:55:16.967301 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:55:16.967371 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:55:17.269804 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:55:45.950589 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:55:45.950678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:55:45.950762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:55:45.950825 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:55:45.950890 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:55:45.950958 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:55:45.951024 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:55:46.259505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:55:47.534320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:55:47.534435 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:55:47.534521 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:55:47.534596 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:55:47.534673 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:55:47.534761 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:55:47.534845 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:55:47.848255 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:55:57.171776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:55:57.171889 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:55:57.171961 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:55:57.172030 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:55:57.172096 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:55:57.172160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:55:57.172225 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:55:57.482319 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:56:16.516210 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:56:16.516307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:56:16.516410 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:56:16.516496 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:56:16.516567 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:56:16.516650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:56:16.516737 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:56:16.820531 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:56:18.109046 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:56:18.109141 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:56:18.109214 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:56:18.109286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:56:18.109358 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:56:18.109432 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:56:18.109504 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:56:18.410139 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:56:47.085634 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:56:47.085731 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:56:47.085797 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:56:47.085862 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:56:47.085926 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:56:47.085990 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:56:47.086053 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:56:47.387531 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:56:48.666148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:56:48.666238 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:56:48.666313 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:56:48.666377 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:56:48.666436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:56:48.666501 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:56:48.666558 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:56:48.972305 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:56:57.291124 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:56:57.291247 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:56:57.291316 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:56:57.292243 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:56:57.292559 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:56:57.292712 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:56:57.292912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:56:57.598119 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:57:17.651322 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:57:17.651426 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:57:17.651502 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:57:17.651581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:57:17.651665 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:57:17.651759 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:57:17.651839 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:57:17.958917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:57:19.239416 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:57:19.239510 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:57:19.239586 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:57:19.239666 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:57:19.239748 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:57:19.239828 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:57:19.239903 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:57:19.538588 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:57:48.216346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:57:48.216450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:57:48.216525 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:57:48.216597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:57:48.216670 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:57:48.216756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:57:48.216824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:57:48.523030 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:57:49.801000 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:57:49.801091 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:57:49.801159 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:57:49.801220 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:57:49.801286 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:57:49.801343 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:57:49.801403 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:57:50.107160 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:57:57.413217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:57:57.413300 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:57:57.413366 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:57:57.413429 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:57:57.413491 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:57:57.413553 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:57:57.413617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:57:57.724887 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:58:18.781444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:58:18.781529 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:58:18.781603 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:58:18.781666 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:58:18.781741 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:58:18.781812 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:58:18.781878 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:58:19.087227 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:58:20.368847 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:58:20.368935 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:58:20.369006 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:58:20.369069 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:58:20.369151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:58:20.369228 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:58:20.369286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:58:20.678414 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:58:49.354353 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:58:49.354458 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:58:49.354532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:58:49.354596 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:58:49.354666 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:58:49.354735 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:58:49.354820 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:58:49.669209 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:58:50.937147 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:58:50.937240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:58:50.937309 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:58:50.937371 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:58:50.937430 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:58:50.937486 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:58:50.937550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:58:51.242428 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:58:57.530831 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:58:57.530908 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:58:57.530977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:58:57.531046 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:58:57.531120 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:58:57.531180 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:58:57.531244 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:58:57.832882 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:59:19.944757 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:59:19.944880 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:59:19.944962 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:59:19.945045 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:59:19.945120 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:59:19.945194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:59:19.945283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:59:20.259113 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:59:21.506570 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:59:21.506664 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:59:21.506750 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:59:21.506822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:59:21.506902 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:59:21.506971 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:59:21.507042 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:59:21.823079 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:59:50.523094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:59:50.523184 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:59:50.523254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:59:50.523319 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:59:50.523390 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:59:50.523455 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:59:50.523521 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:59:50.824751 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:59:52.093480 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:59:52.093571 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:59:52.093641 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:59:52.093724 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:59:52.093801 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:59:52.093869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:59:52.093935 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:59:52.402817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 01:59:57.644906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 01:59:57.644986 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 01:59:57.645050 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 01:59:57.645115 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 01:59:57.645182 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 01:59:57.645244 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 01:59:57.645303 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 01:59:57.959697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:00:21.088399 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:00:21.088485 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:00:21.088550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:00:21.088609 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:00:21.088674 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:00:21.088748 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:00:21.088811 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:00:21.400672 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:00:22.666774 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:00:22.666869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:00:22.666937 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:00:22.667012 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:00:22.667072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:00:22.667134 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:00:22.667196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:00:22.976146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:00:51.668607 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:00:51.668702 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:00:51.668792 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:00:51.668907 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:00:51.668995 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:00:51.669071 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:00:51.669175 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:00:51.976735 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:00:53.238851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:00:53.238943 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:00:53.239009 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:00:53.239073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:00:53.239135 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:00:53.239201 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:00:53.239263 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:00:53.551790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:00:57.763295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:00:57.763390 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:00:57.763464 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:00:57.763542 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:00:57.763618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:00:57.763698 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:00:57.763772 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:00:58.067207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:01:22.252508 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:01:22.252605 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:01:22.252683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:01:22.252759 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:01:22.252837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:01:22.252914 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:01:22.252986 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:01:22.562347 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:01:23.812990 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:01:23.813075 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:01:23.813139 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:01:23.813198 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:01:23.813261 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:01:23.813326 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:01:23.813393 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:01:24.117147 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:01:52.830574 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:01:52.830680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:01:52.830773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:01:52.830863 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:01:52.830931 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:01:52.831008 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:01:52.831084 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:01:53.129235 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:01:54.400383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:01:54.400469 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:01:54.400554 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:01:54.400639 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:01:54.400709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:01:54.400814 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:01:54.400888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:01:54.707974 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:01:57.879991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:01:57.880065 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:01:57.880129 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:01:57.880195 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:01:57.880263 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:01:57.880329 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:01:57.880398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:01:58.187608 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:02:23.392384 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:02:23.392473 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:02:23.392538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:02:23.392620 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:02:23.392682 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:02:23.392758 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:02:23.392826 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:02:23.700327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:02:24.964632 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:02:24.964730 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:02:24.964810 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:02:24.964872 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:02:24.964934 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:02:24.964995 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:02:24.965060 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:02:25.272838 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:02:53.962396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:02:53.962510 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:02:53.962581 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:02:53.962648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:02:53.962711 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:02:53.962782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:02:53.962846 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:02:54.274559 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:02:55.533578 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:02:55.533666 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:02:55.533739 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:02:55.533811 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:02:55.533875 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:02:55.533942 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:02:55.534007 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:02:55.836612 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:02:58.004642 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:02:58.004830 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:02:58.005366 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:02:58.005840 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:02:58.005930 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:02:58.006005 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:02:58.006076 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:02:58.308429 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:03:24.542238 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:03:24.542316 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:03:24.542384 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:03:24.542452 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:03:24.542511 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:03:24.542572 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:03:24.542638 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:03:24.852372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:03:26.096891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:03:26.096976 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:03:26.097053 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:03:26.097124 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:03:26.097185 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:03:26.097251 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:03:26.097311 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:03:26.401724 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:03:55.121597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:03:55.121689 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:03:55.121759 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:03:55.121827 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:03:55.121886 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:03:55.121946 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:03:55.122003 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:03:55.428596 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:03:56.665400 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:03:56.665506 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:03:56.665572 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:03:56.665639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:03:56.665698 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:03:56.665775 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:03:56.665838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:03:56.966884 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:03:58.121232 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:03:58.121312 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:03:58.121376 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:03:58.121448 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:03:58.121508 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:03:58.121568 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:03:58.121628 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:03:58.424495 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:04:25.694063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:04:25.694139 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:04:25.694218 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:04:25.694280 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:04:25.694346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:04:25.694411 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:04:25.694476 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:04:26.000263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:04:27.227599 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:04:27.227690 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:04:27.227762 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:04:27.227825 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:04:27.227890 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:04:27.227952 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:04:27.228014 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:04:27.532348 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:04:56.265038 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:04:56.265140 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:04:56.265209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:04:56.265266 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:04:56.265333 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:04:56.265391 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:04:56.265456 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:04:56.571866 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:04:57.796940 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:04:57.797045 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:04:57.797107 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:04:57.797166 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:04:57.797223 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:04:57.797292 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:04:57.797352 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:04:58.096892 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:04:58.359475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:04:58.359561 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:04:58.359632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:04:58.359703 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:04:58.359775 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:04:58.359843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:04:58.359908 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:04:58.668392 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:05:26.832614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:05:26.832724 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:05:26.832817 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:05:26.832896 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:05:26.832974 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:05:26.833055 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:05:26.833129 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:05:27.138934 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:05:28.360622 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:05:28.360734 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:05:28.360810 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:05:28.360877 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:05:28.360949 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:05:28.361020 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:05:28.361088 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:05:28.666231 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:05:57.399158 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:05:57.399259 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:05:57.399322 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:05:57.399390 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:05:57.399456 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:05:57.399524 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:05:57.399584 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:05:57.714017 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:05:58.374626 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:05:58.374712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:05:58.374790 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:05:58.374857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:05:58.374916 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:05:58.374982 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:05:58.375041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:05:58.682349 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:05:58.950609 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:05:58.950689 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:05:58.950768 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:05:58.950833 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:05:58.950899 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:05:58.950963 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:05:58.951025 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:05:59.253972 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:06:27.972507 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:06:27.972614 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:06:27.972707 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:06:27.973676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:06:27.973914 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:06:27.974104 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:06:27.974268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:06:28.306200 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:06:29.511408 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:06:29.511520 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:06:29.511604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:06:29.511677 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:06:29.511773 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:06:29.511859 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:06:29.511939 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:06:29.810234 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:06:58.503838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:06:58.503953 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:06:58.504028 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:06:58.504103 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:06:58.504166 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:06:58.504252 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:06:58.504314 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:06:58.806306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:06:59.068674 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:06:59.068786 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:06:59.068865 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:06:59.068943 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:06:59.069020 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:06:59.069095 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:06:59.069177 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:06:59.376958 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:07:00.076212 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:07:00.076329 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:07:00.076410 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:07:00.076497 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:07:00.076573 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:07:00.076658 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:07:00.076749 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:07:00.383242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:07:29.068939 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:07:29.069039 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:07:29.069130 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:07:29.069222 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:07:29.069307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:07:29.069391 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:07:29.069466 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:07:29.381680 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:07:30.655961 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:07:30.656070 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:07:30.656156 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:07:30.656228 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:07:30.656321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:07:30.656400 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:07:30.656498 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:07:30.963167 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:07:58.626262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:07:58.626346 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:07:58.626422 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:07:58.626501 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:07:58.626565 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:07:58.626630 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:07:58.626693 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:07:58.939993 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:07:59.651050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:07:59.651151 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:07:59.651216 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:07:59.651281 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:07:59.651343 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:07:59.651402 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:07:59.651469 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:07:59.963314 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:08:01.224701 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:08:01.224792 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:08:01.224859 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:08:01.224921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:08:01.224992 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:08:01.225056 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:08:01.225121 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:08:01.533514 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:08:30.226081 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:08:30.226161 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:08:30.226228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:08:30.226295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:08:30.226358 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:08:30.226418 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:08:30.226483 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:08:30.535662 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:08:31.795641 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:08:31.795734 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:08:31.795799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:08:31.795874 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:08:31.795933 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:08:31.796005 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:08:31.796063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:08:32.123872 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:08:58.778574 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:08:58.778661 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:08:58.778745 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:08:58.778820 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:08:58.778890 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:08:58.778960 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:08:58.779038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:08:59.089231 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:09:00.796263 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:09:00.796344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:09:00.796426 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:09:00.796491 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:09:00.796555 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:09:00.796622 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:09:00.796685 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:09:01.100639 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:09:02.395463 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:09:02.395543 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:09:02.395608 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:09:02.395667 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:09:02.395736 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:09:02.395799 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:09:02.395864 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:09:02.692390 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:09:31.356395 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:09:31.356475 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:09:31.356540 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:09:31.356621 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:09:31.356681 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:09:31.356752 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:09:31.356819 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:09:31.669713 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:09:32.948340 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:09:32.948423 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:09:32.948490 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:09:32.948552 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:09:32.948613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:09:32.948688 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:09:32.948762 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:09:33.259538 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:09:58.898330 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:09:58.898410 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:09:58.898475 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:09:58.898537 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:09:58.898607 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:09:58.898668 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:09:58.898738 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:09:59.215113 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:10:01.933229 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:10:01.933326 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:10:01.933408 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:10:01.933493 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:10:01.933564 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:10:01.933644 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:10:01.933724 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:10:02.246536 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:10:03.521308 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:10:03.521418 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:10:03.521499 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:10:03.521571 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:10:03.521648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:10:03.521730 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:10:03.521800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:10:03.830806 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:10:32.513465 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:10:32.513551 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:10:32.513621 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:10:32.513694 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:10:32.513761 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:10:32.513837 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:10:32.513903 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:10:32.817107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:10:34.096952 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:10:34.097039 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:10:34.097110 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:10:34.097172 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:10:34.097244 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:10:34.097309 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:10:34.097380 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:10:34.402101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:10:59.024304 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:10:59.024391 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:10:59.024453 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:10:59.024529 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:10:59.024595 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:10:59.024657 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:10:59.024723 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:10:59.332616 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:11:03.083380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:11:03.083479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:11:03.083554 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:11:03.083637 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:11:03.083712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:11:03.083816 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:11:03.083891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:11:03.388753 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:11:04.659701 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:11:04.659808 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:11:04.659881 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:11:04.659969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:11:04.660035 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:11:04.660108 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:11:04.660172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:11:04.983005 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:11:33.655626 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:11:33.655714 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:11:33.655793 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:11:33.655862 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:11:33.655939 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:11:33.656014 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:11:33.656106 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:11:33.958707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:11:35.257302 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:11:35.257376 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:11:35.257451 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:11:35.257530 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:11:35.257598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:11:35.257658 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:11:35.257723 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:11:35.565604 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:11:59.148658 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:11:59.148758 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:11:59.148822 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:11:59.148894 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:11:59.148955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:11:59.149020 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:11:59.149077 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:11:59.458423 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:12:04.231597 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:12:04.231684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:12:04.231763 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:12:04.231827 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:12:04.231889 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:12:04.231950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:12:04.232013 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:12:04.538889 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:12:05.828668 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:12:05.828802 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:12:05.828883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:12:05.828968 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:12:05.829067 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:12:05.829156 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:12:05.829237 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:12:06.135909 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:12:34.805681 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:12:34.805782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:12:34.805858 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:12:34.805928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:12:34.805998 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:12:34.806064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:12:34.806136 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:12:35.119286 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:12:36.396607 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:12:36.396690 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:12:36.396774 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:12:36.396843 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:12:36.396910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:12:36.396977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:12:36.397039 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:12:36.710278 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:12:59.268505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:12:59.268587 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:12:59.268653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:12:59.268730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:12:59.268792 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:12:59.268860 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:12:59.268930 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:12:59.574228 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:13:05.383313 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:13:05.383424 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:13:05.383509 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:13:05.383590 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:13:05.383668 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:13:05.383746 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:13:05.383828 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:13:05.689740 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:13:06.970938 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:13:06.972216 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:13:06.972511 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:13:06.972752 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:13:06.972917 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:13:06.973370 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:13:06.973752 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:13:07.279547 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:13:35.952006 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:13:35.952095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:13:35.952178 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:13:35.952250 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:13:35.952319 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:13:35.952386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:13:35.952455 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:13:36.260408 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:13:37.543829 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:13:37.543920 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:13:37.543992 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:13:37.544061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:13:37.544121 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:13:37.544186 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:13:37.544248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:13:37.850656 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:13:59.389765 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:13:59.389849 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:13:59.389912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:13:59.389977 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:13:59.390041 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:13:59.390107 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:13:59.390169 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:13:59.694309 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:14:06.515350 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:14:06.515460 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:14:06.515539 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:14:06.515600 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:14:06.515659 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:14:06.515729 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:14:06.515807 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:14:06.844687 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:14:08.106453 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:14:08.106567 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:14:08.106629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:14:08.106698 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:14:08.106780 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:14:08.106847 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:14:08.106907 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:14:08.411080 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:14:37.115690 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:14:37.115782 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:14:37.115845 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:14:37.115907 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:14:37.115987 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:14:37.116060 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:14:37.116132 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:14:37.427577 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:14:38.671957 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:14:38.672053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:14:38.672124 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:14:38.672190 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:14:38.672251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:14:38.672312 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:14:38.672377 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:14:38.979546 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:14:59.519984 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:14:59.520071 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:14:59.520144 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:14:59.520226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:14:59.520297 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:14:59.520367 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:14:59.520432 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:14:59.832788 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:15:07.691050 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:15:07.691135 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:15:07.691199 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:15:07.691264 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:15:07.691329 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:15:07.691398 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:15:07.691460 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:15:08.008298 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:15:09.241393 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:15:09.241473 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:15:09.241545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:15:09.241607 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:15:09.241672 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:15:09.241739 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:15:09.241819 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:15:09.551756 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:15:38.271742 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:15:38.271860 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:15:38.271929 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:15:38.271990 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:15:38.272059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:15:38.272123 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:15:38.272197 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:15:38.578865 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:15:39.817792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:15:39.817943 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:15:39.818017 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:15:39.818145 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:15:39.818226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:15:39.818298 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:15:39.818382 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:15:40.127117 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:15:59.646619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:15:59.646715 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:15:59.646824 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:15:59.646902 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:15:59.646981 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:15:59.647056 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:15:59.647144 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:15:59.957707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:16:08.834742 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:16:08.834841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:16:08.834923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:16:08.834987 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:16:08.835064 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:16:08.835129 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:16:08.835196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:16:09.131226 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:16:10.389261 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:16:10.389351 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:16:10.389415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:16:10.389482 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:16:10.389544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:16:10.389611 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:16:10.389669 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:16:10.690476 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:16:39.404383 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:16:39.404461 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:16:39.404519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:16:39.404585 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:16:39.404648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:16:39.404729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:16:39.404794 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:16:39.707207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:16:40.948452 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:16:40.948536 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:16:40.948617 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:16:40.948684 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:16:40.948753 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:16:40.948819 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:16:40.948886 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:16:41.255678 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:16:59.773970 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:16:59.774075 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:16:59.774152 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:16:59.774237 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:16:59.774313 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:16:59.774398 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:16:59.774475 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:17:00.087167 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:17:09.975907 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:17:09.976007 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:17:09.976098 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:17:09.976179 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:17:09.976254 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:17:09.976326 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:17:09.976398 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:17:10.312273 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 02:17:11.514320 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:17:11.514417 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:17:11.514498 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:17:11.514589 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:17:11.514673 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:17:11.514749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:17:11.514823 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:17:11.817292 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 02:17:40.576044 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:17:40.576131 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:17:40.576203 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:17:40.576269 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:17:40.576336 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:17:40.576407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:17:40.576464 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:17:40.882069 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 02:17:42.086015 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:17:42.086099 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:17:42.086164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:17:42.086233 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:17:42.086294 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:17:42.086363 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:17:42.086428 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:17:42.394567 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 02:17:59.897548 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:17:59.897821 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:17:59.898022 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:17:59.898775 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:17:59.898884 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:17:59.898970 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:17:59.899108 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:18:00.217801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 02:18:11.146247 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:18:11.146339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:18:11.146423 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:18:11.146495 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:18:11.146566 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:18:11.146632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:18:11.146704 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:18:11.453433 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:18:12.663986 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:18:12.664089 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:18:12.664155 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:18:12.664225 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:18:12.664286 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:18:12.664353 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:18:12.664415 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:18:12.974521 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:18:41.724259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:18:41.724365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:18:41.724450 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:18:41.724513 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:18:41.724580 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:18:41.724644 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:18:41.724714 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:18:42.045001 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:18:43.235089 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:18:43.235186 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:18:43.235270 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:18:43.235358 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:18:43.235439 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:18:43.235512 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:18:43.235588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:18:43.544796 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:19:00.023519 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:19:00.023641 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:19:00.023734 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:19:00.023817 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:19:00.023894 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:19:00.023970 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:19:00.024064 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:19:00.344256 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:19:12.322242 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:19:12.322372 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:19:12.322449 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:19:12.322525 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:19:12.322635 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:19:12.322707 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:19:12.322810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:19:12.624518 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:19:13.812126 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:19:13.812245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:19:13.812314 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:19:13.812392 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:19:13.812469 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:19:13.812547 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:19:13.812621 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:19:14.122942 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:19:42.884141 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:19:42.884244 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:19:42.884323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:19:42.884402 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:19:42.884479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:19:42.884556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:19:42.884630 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:19:43.183011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:19:44.388958 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:19:44.389048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:19:44.389127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:19:44.389203 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:19:44.389279 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:19:44.389346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:19:44.389419 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:19:44.704571 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:20:00.146236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:20:00.146322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:20:00.146382 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:20:00.146460 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:20:00.146524 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:20:00.146590 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:20:00.146650 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:20:00.458826 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:20:13.435757 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:20:13.435867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:20:13.435931 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:20:13.435995 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:20:13.436065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:20:13.436129 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:20:13.436193 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:20:13.742622 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:20:14.966770 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:20:14.966845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:20:14.966924 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:20:14.966990 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:20:14.967060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:20:14.967126 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:20:14.967185 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:20:15.270391 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:20:44.009030 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:20:44.009114 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:20:44.009181 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:20:44.009243 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:20:44.009309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:20:44.009364 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:20:44.009427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:20:44.325439 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:20:45.526418 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:20:45.526509 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:20:45.526588 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:20:45.526652 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:20:45.526713 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:20:45.526791 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:20:45.526852 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:20:45.828263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:21:00.270473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:21:00.270555 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:21:00.270628 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:21:00.270692 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:21:00.270767 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:21:00.270827 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:21:00.270890 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:21:00.579781 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:21:14.601298 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:21:14.601382 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:21:14.601450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:21:14.601515 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:21:14.601576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:21:14.601635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:21:14.601703 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:21:14.907535 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:21:16.089233 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:21:16.089334 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:21:16.090354 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:21:16.090585 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:21:16.090753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:21:16.090899 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:21:16.091032 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:21:16.392621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:21:45.168994 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:21:45.169114 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:21:45.169187 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:21:45.169268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:21:45.169342 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:21:45.169418 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:21:45.169503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:21:45.479333 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:21:46.656280 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:21:46.656378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:21:46.656456 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:21:46.656525 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:21:46.656598 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:21:46.656665 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:21:46.656743 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:21:46.962406 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:22:00.403492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:22:00.403580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:22:00.403654 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:22:00.403733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:22:00.403806 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:22:00.403871 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:22:00.403952 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:22:00.712642 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:22:15.739444 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:22:15.739556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:22:15.739632 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:22:15.739698 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:22:15.739779 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:22:15.739882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:22:15.739951 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:22:16.050346 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:22:17.226698 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:22:17.226807 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:22:17.226883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:22:17.226959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:22:17.227031 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:22:17.227118 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:22:17.227196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:22:17.532399 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:22:46.314041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:22:46.314139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:22:46.314220 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:22:46.314301 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:22:46.314408 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:22:46.314482 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:22:46.314550 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:22:46.621855 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:22:47.796267 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:22:47.796356 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:22:47.796421 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:22:47.796494 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:22:47.796554 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:22:47.796620 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:22:47.796685 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:22:48.106975 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:23:00.529183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:23:00.529270 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:23:00.529343 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:23:00.529415 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:23:00.529492 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:23:00.529563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:23:00.529634 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:23:00.834446 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:23:16.880350 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:23:16.880435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:23:16.880522 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:23:16.880591 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:23:16.880658 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:23:16.880723 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:23:16.880787 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:23:17.188360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:23:18.366019 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:23:18.366112 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:23:18.366187 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:23:18.366259 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:23:18.366325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:23:18.366387 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:23:18.366453 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:23:18.677620 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 02:23:47.449297 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:23:47.449396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:23:47.449476 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:23:47.449554 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:23:47.449631 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:23:47.449704 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:23:47.449792 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:23:47.756197 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 02:23:48.945665 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:23:48.945949 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:23:48.946469 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:23:48.947101 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:23:48.947990 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:23:48.948114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:23:48.948191 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:23:49.262055 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 02:24:00.651651 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:24:00.651735 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:24:00.651804 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:24:00.651869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:24:00.651938 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:24:00.652001 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:24:00.652067 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:24:00.961920 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 02:24:18.013400 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:24:18.013487 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:24:18.013554 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:24:18.013625 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:24:18.013688 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:24:18.013763 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:24:18.013824 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:24:18.323344 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:24:19.528909 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:24:19.528991 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:24:19.529058 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:24:19.529121 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:24:19.529189 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:24:19.529250 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:24:19.529313 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:24:19.843192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:24:48.581361 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:24:48.581475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:24:48.581542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:24:48.581609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:24:48.581679 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:24:48.581757 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:24:48.581819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:24:48.885906 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:24:50.110199 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:24:50.110292 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:24:50.110369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:24:50.110438 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:24:50.110509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:24:50.110577 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:24:50.110644 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:24:50.418342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:25:00.778281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:25:00.778403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:25:00.778488 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:25:00.778570 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:25:00.778645 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:25:00.778728 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:25:00.778817 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:25:01.084032 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:25:19.147445 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:25:19.147529 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:25:19.147601 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:25:19.147675 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:25:19.147747 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:25:19.147809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:25:19.147880 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:25:19.458922 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:25:20.683755 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:25:20.683867 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:25:20.683933 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:25:20.684015 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:25:20.684078 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:25:20.684145 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:25:20.684204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:25:20.987285 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:25:49.718247 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:25:49.718341 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:25:49.718413 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:25:49.718494 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:25:49.718560 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:25:49.718619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:25:49.718685 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:25:50.030342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:25:51.247001 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:25:51.247093 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:25:51.247163 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:25:51.247230 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:25:51.247295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:25:51.247368 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:25:51.247429 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:25:51.547653 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:26:00.902733 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:26:00.902808 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:26:00.902874 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:26:00.902938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:26:00.903008 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:26:00.903069 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:26:00.903144 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:26:01.214440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:26:20.295689 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:26:20.295782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:26:20.295851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:26:20.295916 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:26:20.295981 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:26:20.296051 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:26:20.296113 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:26:20.611439 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:26:21.819895 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:26:21.819983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:26:21.820065 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:26:21.820133 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:26:21.820202 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:26:21.820267 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:26:21.820342 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:26:22.124139 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:26:50.880324 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:26:50.880407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:26:50.880476 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:26:50.880542 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:26:50.880607 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:26:50.880667 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:26:50.880738 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:26:51.189061 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:26:52.387949 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:26:52.388051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:26:52.388122 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:26:52.388198 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:26:52.388267 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:26:52.388334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:26:52.388394 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:26:52.702141 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:27:01.027145 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:27:01.027227 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:27:01.027293 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:27:01.027362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:27:01.027423 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:27:01.027491 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:27:01.027555 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:27:01.334128 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:27:21.450088 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:27:21.450193 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:27:21.450312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:27:21.450414 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:27:21.450494 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:27:21.450596 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:27:21.450678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:27:21.751969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:27:22.965396 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:27:22.965496 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:27:22.965583 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:27:22.965661 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:27:22.965749 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:27:22.965829 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:27:22.965910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:27:23.269263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:27:52.014967 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:27:52.015067 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:27:52.015146 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:27:52.015233 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:27:52.015314 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:27:52.015387 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:27:52.015469 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:27:52.342765 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:27:53.523457 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:27:53.523568 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:27:53.523646 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:27:53.523726 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:27:53.523803 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:27:53.523876 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:27:53.523957 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:27:53.823596 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:28:01.154237 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:28:01.154325 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:28:01.154401 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:28:01.154478 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:28:01.154548 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:28:01.154633 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:28:01.154705 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:28:01.456306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:28:22.603383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:28:22.603483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:28:22.603558 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:28:22.603642 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:28:22.603709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:28:22.603797 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:28:22.603872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:28:22.902327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:28:24.088190 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:28:24.088281 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:28:24.088362 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:28:24.088446 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:28:24.088532 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:28:24.088611 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:28:24.088680 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:28:24.394286 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:28:53.157726 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:28:53.157817 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:28:53.157885 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:28:53.157958 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:28:53.158029 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:28:53.158102 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:28:53.158179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:28:53.463239 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:28:54.653386 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:28:54.653472 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:28:54.653548 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:28:54.653611 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:28:54.653679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:28:54.653749 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:28:54.653818 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:28:54.958595 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:29:01.277936 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:29:01.278035 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:29:01.278106 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:29:01.278189 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:29:01.278260 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:29:01.278341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:29:01.278412 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:29:01.594119 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:29:23.727849 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:29:23.727946 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:29:23.728022 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:29:23.728099 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:29:23.728181 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:29:23.728268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:29:23.728339 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:29:24.037765 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:29:25.229777 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:29:25.229884 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:29:25.229967 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:29:25.230046 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:29:25.230135 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:29:25.230219 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:29:25.230292 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:29:25.542115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:29:54.301447 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:29:54.301535 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:29:54.301600 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:29:54.301675 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:29:54.301739 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:29:54.301818 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:29:54.301883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:29:54.605703 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:29:55.806594 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:29:55.806677 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:29:55.806748 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:29:55.806818 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:29:55.806883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:29:55.806942 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:29:55.807007 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:29:56.115060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:30:01.400331 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:30:01.400419 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:30:01.400483 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:30:01.400551 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:30:01.400625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:30:01.400691 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:30:01.400766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:30:01.709779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:30:24.864685 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:30:24.864783 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:30:24.864852 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:30:24.864912 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:30:24.864975 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:30:24.865042 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:30:24.865103 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:30:25.182662 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:30:26.380700 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:30:26.380799 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:30:26.380871 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:30:26.380934 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:30:26.380999 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:30:26.381057 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:30:26.381118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:30:26.687875 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:30:55.445569 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:30:55.445656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:30:55.445742 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:30:55.445823 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:30:55.445895 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:30:55.445976 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:30:55.446046 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:30:55.758649 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:30:56.951819 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:30:56.951904 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:30:56.951974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:30:56.952051 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:30:56.952115 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:30:56.952180 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:30:56.952242 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:30:57.259045 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:31:01.524358 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:31:01.524437 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:31:01.524500 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:31:01.524566 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:31:01.524630 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:31:01.524698 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:31:01.524764 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:31:01.841803 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:31:26.016571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:31:26.016661 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:31:26.016729 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:31:26.016797 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:31:26.016853 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:31:26.016916 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:31:26.016977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:31:26.327753 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:31:27.520803 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:31:27.520905 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:31:27.520965 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:31:27.521029 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:31:27.521090 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:31:27.521156 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:31:27.521215 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:31:27.825904 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:31:56.590565 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:31:56.590649 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:31:56.590738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:31:56.590801 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:31:56.590870 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:31:56.590939 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:31:56.591004 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:31:56.896452 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:31:58.084004 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:31:58.084137 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:31:58.084215 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:31:58.084310 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:31:58.084378 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:31:58.084479 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:31:58.084579 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:31:58.391322 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:32:01.640126 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:32:01.640222 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:32:01.640299 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:32:01.640370 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:32:01.640452 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:32:01.640526 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:32:01.640598 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:32:01.962470 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:32:27.157641 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:32:27.157745 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:32:27.157834 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:32:27.157917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:32:27.157991 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:32:27.158065 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:32:27.158156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:32:27.466735 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:32:28.654307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:32:28.654410 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:32:28.654481 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:32:28.654558 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:32:28.654644 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:32:28.654715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:32:28.654806 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:32:28.975498 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:32:57.735527 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:32:57.735644 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:32:57.735724 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:32:57.735802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:32:57.735882 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:32:57.735950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:32:57.736023 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:32:58.039315 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:32:59.243569 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:32:59.243681 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:32:59.243772 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:32:59.243851 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:32:59.243931 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:32:59.244015 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:32:59.244090 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:32:59.550568 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:33:01.764698 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:33:01.764795 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:33:01.764863 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:33:01.764936 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:33:01.765005 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:33:01.765064 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:33:01.765134 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:33:02.091452 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:33:28.299730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:33:28.299823 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:33:28.299893 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:33:28.299964 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:33:28.300027 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:33:28.300091 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:33:28.300152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:33:28.609285 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:33:29.816528 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:33:29.816626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:33:29.816694 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:33:29.816765 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:33:29.816837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:33:29.816900 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:33:29.816975 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:33:30.119152 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:33:58.866651 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:33:58.866750 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:33:58.866823 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:33:58.866900 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:33:58.866971 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:33:58.867040 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:33:58.867103 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:33:59.179035 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 02:34:00.373248 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:34:00.373328 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:34:00.373403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:34:00.373471 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:34:00.373531 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:34:00.373592 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:34:00.373653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:34:00.675085 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 02:34:01.881428 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:34:01.881518 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:34:01.881586 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:34:01.881650 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:34:01.881713 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:34:01.881785 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:34:01.881849 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:34:02.192556 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 02:34:29.443247 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:34:29.443343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:34:29.443412 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:34:29.443483 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:34:29.443551 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:34:29.443628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:34:29.443691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:34:29.750063 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:34:30.930060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:34:30.930134 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:34:30.930209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:34:30.930267 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:34:30.930332 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:34:30.930400 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:34:30.930466 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:34:31.228592 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:35:00.010097 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:35:00.010190 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:35:00.010258 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:35:00.010328 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:35:00.010393 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:35:00.010462 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:35:00.010523 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:35:00.318279 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:35:01.485891 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:35:01.486015 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:35:01.486107 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:35:01.486198 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:35:01.486263 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:35:01.486337 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:35:01.486410 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:35:01.807036 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:35:02.092110 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:35:02.092191 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:35:02.092265 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:35:02.092324 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:35:02.092390 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:35:02.092457 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:35:02.092519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:35:02.398079 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:35:30.585852 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:35:30.585972 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:35:30.586042 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:35:30.586108 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:35:30.586183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:35:30.586245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:35:30.586305 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:35:30.892669 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:35:32.093922 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:35:32.094012 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:35:32.094084 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:35:32.094152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:35:32.094223 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:35:32.094291 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:35:32.094357 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:35:32.398464 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:36:01.155983 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:36:01.156062 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:36:01.156151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:36:01.156210 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:36:01.156281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:36:01.156339 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:36:01.156403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:36:01.463516 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:36:02.122665 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:36:02.122760 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:36:02.122830 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:36:02.122901 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:36:02.122969 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:36:02.123029 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:36:02.123091 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:36:02.436371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:36:02.698685 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:36:02.698777 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:36:02.698846 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:36:02.698915 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:36:02.698986 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:36:02.699046 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:36:02.699107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:36:02.998241 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:36:31.724847 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:36:31.724922 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:36:31.724982 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:36:31.725044 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:36:31.725099 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:36:31.725161 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:36:31.725220 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:36:32.043596 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:36:33.267589 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:36:33.267704 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:36:33.267785 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:36:33.267863 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:36:33.267943 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:36:33.268010 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:36:33.268089 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:36:33.574183 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:37:02.253669 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:37:02.253751 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:37:02.253834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:37:02.253915 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:37:02.253978 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:37:02.254047 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:37:02.254116 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:37:02.565386 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:37:02.825807 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:37:02.825891 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:37:02.825972 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:37:02.826039 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:37:02.826105 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:37:02.826167 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:37:02.826227 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:37:03.134362 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:37:03.836579 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:37:03.836679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:37:03.836745 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:37:03.836812 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:37:03.836873 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:37:03.836936 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:37:03.837000 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:37:04.143177 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:37:32.830351 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:37:32.830521 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:37:32.831056 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:37:32.831454 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:37:32.831533 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:37:32.831629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:37:32.831712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:37:33.146018 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:37:34.406133 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:37:34.406228 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:37:34.406296 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:37:34.406361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:37:34.406424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:37:34.406486 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:37:34.406547 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:37:34.711042 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:38:02.393264 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:38:02.393344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:38:02.393434 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:38:02.393512 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:38:02.393575 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:38:02.393637 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:38:02.393700 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:38:02.696783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:38:03.408640 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:38:03.408738 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:38:03.408803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:38:03.408873 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:38:03.408934 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:38:03.409000 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:38:03.409068 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:38:03.713793 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:38:04.978973 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:38:04.979051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:38:04.979116 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:38:04.979181 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:38:04.979244 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:38:04.979304 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:38:04.979371 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:38:05.284400 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:38:33.977912 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:38:33.978013 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:38:33.978101 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:38:33.978169 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:38:33.978233 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:38:33.978296 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:38:33.978356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:38:34.287768 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:38:35.540763 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:38:35.540850 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:38:35.540931 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:38:35.541023 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:38:35.541085 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:38:35.541151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:38:35.541231 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:38:35.848182 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:39:02.513262 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:39:02.513346 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:39:02.513408 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:39:02.513478 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:39:02.513539 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:39:02.513603 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:39:02.513666 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:39:02.819808 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:39:04.551689 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:39:04.551799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:39:04.551869 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:39:04.551938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:39:04.551994 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:39:04.552063 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:39:04.552128 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:39:04.867694 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:39:06.108023 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:39:06.108108 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:39:06.108165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:39:06.108237 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:39:06.108302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:39:06.108365 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:39:06.108430 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:39:06.413167 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:39:35.131995 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:39:35.132085 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:39:35.132159 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:39:35.132225 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:39:35.132287 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:39:35.132350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:39:35.132416 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:39:35.443380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:39:36.672999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:39:36.673094 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:39:36.673177 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:39:36.673241 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:39:36.673299 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:39:36.673359 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:39:36.673424 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:39:36.978877 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:40:02.640218 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:40:02.640325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:40:02.640404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:40:02.640483 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:40:02.640564 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:40:02.640637 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:40:02.640716 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:40:02.939835 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:40:05.702688 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:40:05.702787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:40:05.702859 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:40:05.702938 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:40:05.703008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:40:05.703072 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:40:05.703138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:40:06.005257 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:40:07.237553 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:40:07.237663 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:40:07.237760 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:40:07.237836 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:40:07.237920 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:40:07.237998 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:40:07.238076 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:40:07.542888 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:40:36.266296 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:40:36.266409 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:40:36.266478 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:40:36.266551 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:40:36.266621 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:40:36.266688 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:40:36.266766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:40:36.585102 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:40:37.802041 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:40:37.802129 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:40:37.802204 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:40:37.802270 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:40:37.802338 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:40:37.802401 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:40:37.802461 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:40:38.108672 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:41:02.759697 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:41:02.759898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:41:02.760025 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:41:02.760189 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:41:02.760555 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:41:02.761267 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:41:02.761612 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:41:03.071432 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:41:06.851761 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:41:06.851876 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:41:06.851946 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:41:06.852010 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:41:06.852071 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:41:06.852136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:41:06.852198 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:41:07.153831 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:41:08.371288 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:41:08.371383 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:41:08.371447 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:41:08.371514 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:41:08.371580 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:41:08.371649 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:41:08.371722 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:41:08.682474 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:41:37.413585 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:41:37.413690 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:41:37.413760 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:41:37.413834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:41:37.413902 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:41:37.413971 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:41:37.414031 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:41:37.713801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:41:38.937471 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:41:38.937562 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:41:38.937627 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:41:38.937698 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:41:38.937767 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:41:38.937857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:41:38.937920 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:41:39.248943 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:42:02.879282 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:42:02.879358 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:42:02.879425 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:42:02.879487 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:42:02.879559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:42:02.879619 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:42:02.879681 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:42:03.189498 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:42:07.970127 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:42:07.970232 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:42:07.970322 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:42:07.970413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:42:07.970498 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:42:07.970577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:42:07.970664 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:42:08.279755 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:42:09.510578 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:42:09.510678 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:42:09.510757 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:42:09.510823 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:42:09.510892 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:42:09.510959 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:42:09.511032 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:42:09.818246 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:42:38.546910 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:42:38.547026 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:42:38.547107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:42:38.547179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:42:38.547260 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:42:38.547328 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:42:38.547404 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:42:38.854984 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:42:40.101743 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:42:40.101845 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:42:40.101915 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:42:40.101988 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:42:40.102071 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:42:40.102153 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:42:40.102221 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:42:40.405877 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:43:02.999995 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:43:03.000110 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:43:03.000210 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:43:03.000286 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:43:03.000366 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:43:03.000448 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:43:03.000524 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:43:03.303978 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:43:09.113944 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:43:09.114055 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:43:09.114135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:43:09.114208 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:43:09.114280 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:43:09.114347 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:43:09.114425 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:43:09.431015 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:43:10.673693 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:43:10.673860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:43:10.673959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:43:10.674066 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:43:10.674162 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:43:10.674244 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:43:10.674329 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:43:10.977921 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:43:39.698996 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:43:39.699113 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:43:39.699201 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:43:39.699287 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:43:39.699365 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:43:39.699455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:43:39.699537 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:43:40.004254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:43:41.242634 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:43:41.242728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:43:41.242833 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:43:41.242914 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:43:41.242991 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:43:41.243059 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:43:41.243134 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:43:41.560123 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:44:03.123074 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:44:03.123166 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:44:03.123238 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:44:03.123311 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:44:03.123374 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:44:03.123451 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:44:03.123518 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:44:03.431087 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:44:10.282724 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:44:10.282837 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:44:10.282930 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:44:10.283012 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:44:10.283102 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:44:10.283180 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:44:10.283258 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:44:10.589067 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:44:11.833092 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:44:11.833191 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:44:11.833265 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:44:11.833338 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:44:11.833408 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:44:11.833486 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:44:11.833555 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:44:12.149538 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:44:40.852093 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:44:40.852197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:44:40.852268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:44:40.852339 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:44:40.852416 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:44:40.852480 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:44:40.852545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:44:41.161581 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:44:42.413897 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:44:42.414005 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:44:42.414075 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:44:42.414136 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:44:42.414202 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:44:42.414263 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:44:42.414325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:44:42.717397 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:45:03.244038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:45:03.244115 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:45:03.244183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:45:03.244255 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:45:03.244315 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:45:03.244379 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:45:03.244438 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:45:03.546891 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:45:11.423804 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:45:11.423914 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:45:11.423975 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:45:11.424038 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:45:11.424098 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:45:11.424159 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:45:11.424216 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:45:11.726289 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:45:12.980447 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:45:12.980536 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:45:12.980606 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:45:12.980676 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:45:12.980754 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:45:12.980819 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:45:12.980881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:45:13.285890 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:45:42.006347 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:45:42.006450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:45:42.006550 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:45:42.006641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:45:42.006715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:45:42.006795 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:45:42.006866 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:45:42.324675 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:45:43.544400 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:45:43.544514 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:45:43.544578 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:45:43.544641 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:45:43.544708 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:45:43.544782 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:45:43.544843 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:45:43.853332 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:46:03.368073 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:46:03.368153 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:46:03.368225 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:46:03.368286 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:46:03.368348 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:46:03.368406 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:46:03.368468 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:46:03.677478 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:46:12.588929 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:46:12.589021 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:46:12.589087 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:46:12.589146 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:46:12.589222 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:46:12.589284 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:46:12.589346 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:46:12.899280 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:46:14.115104 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:46:14.115195 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:46:14.115270 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:46:14.115334 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:46:14.115396 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:46:14.115466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:46:14.115528 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:46:14.434370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:46:43.161684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:46:43.161801 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:46:43.161867 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:46:43.161930 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:46:43.161999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:46:43.162067 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:46:43.162129 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:46:43.463740 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:46:44.700935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:46:44.701127 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:46:44.701821 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:46:44.701934 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:46:44.702022 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:46:44.702099 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:46:44.702178 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:46:45.010702 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:47:03.492386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:47:03.492478 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:47:03.492558 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:47:03.492643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:47:03.492730 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:47:03.492802 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:47:03.492875 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:47:03.804330 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:47:13.727442 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:47:13.727538 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:47:13.727619 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:47:13.727702 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:47:13.727793 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:47:13.727872 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:47:13.727947 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:47:14.042231 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:47:15.269470 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:47:15.269568 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:47:15.269643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:47:15.269713 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:47:15.269796 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:47:15.269874 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:47:15.269942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:47:15.574748 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:47:44.307567 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:47:44.307670 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:47:44.307755 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:47:44.307833 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:47:44.307908 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:47:44.308000 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:47:44.308067 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:47:44.620401 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:47:45.839113 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:47:45.839204 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:47:45.839288 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:47:45.839361 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:47:45.839434 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:47:45.839514 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:47:45.839589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:47:46.143155 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:48:03.574075 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:48:03.574156 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:48:03.574226 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:48:03.574286 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:48:03.574357 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:48:03.574416 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:48:03.574478 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:48:03.884895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:48:14.878074 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:48:14.878194 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:48:14.878262 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:48:14.878334 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:48:14.878402 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:48:14.878470 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:48:14.878538 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:48:15.183145 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:48:16.404982 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:48:16.405080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:48:16.405158 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:48:16.405234 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:48:16.405313 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:48:16.405397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:48:16.405482 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:48:16.713665 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:48:45.449296 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:48:45.449387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:48:45.449461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:48:45.449535 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:48:45.449613 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:48:45.449689 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:48:45.449774 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:48:45.769691 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:48:46.970217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:48:46.970299 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:48:46.970396 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:48:46.970458 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:48:46.970522 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:48:46.970595 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:48:46.970657 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:48:47.281285 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:49:03.695113 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:49:03.695198 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:49:03.695268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:49:03.695345 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:49:03.695411 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:49:03.695469 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:49:03.695534 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:49:03.999647 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:49:16.028877 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:49:16.028961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:49:16.029029 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:49:16.029098 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:49:16.029166 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:49:16.029226 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:49:16.029296 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:49:16.335280 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:49:17.548453 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:49:17.548548 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:49:17.548622 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:49:17.548704 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:49:17.548792 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:49:17.548872 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:49:17.548947 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:49:17.866219 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:49:46.601819 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:49:46.601924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:49:46.602006 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:49:46.602078 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:49:46.602149 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:49:46.602226 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:49:46.602295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:49:46.907736 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:49:48.127146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:49:48.127262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:49:48.127330 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:49:48.127393 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:49:48.127464 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:49:48.127527 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:49:48.127595 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:49:48.434818 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:50:03.818618 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:50:03.818729 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:50:03.818837 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:50:03.818918 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:50:03.818996 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:50:03.819069 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:50:03.819145 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:50:04.126860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:50:17.166712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:50:17.166831 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:50:17.166930 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:50:17.167003 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:50:17.168156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:50:17.168523 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:50:17.169209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:50:17.470266 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:50:18.699930 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:50:18.700034 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:50:18.700099 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:50:18.700163 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:50:18.700234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:50:18.700303 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:50:18.700375 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:50:18.999450 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:50:47.735098 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:50:47.735206 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:50:47.735276 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:50:47.735339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:50:47.735409 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:50:47.735468 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:50:47.735532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:50:48.039524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:50:49.261549 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:50:49.261665 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:50:49.261775 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:50:49.261852 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:50:49.261927 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:50:49.262013 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:50:49.262091 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:50:49.570239 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:51:03.936353 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:51:03.936438 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:51:03.936517 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:51:03.936595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:51:03.936668 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:51:03.936742 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:51:03.936812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:51:04.247811 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:51:18.299097 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:51:18.299184 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:51:18.299259 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:51:18.299316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:51:18.299388 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:51:18.299447 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:51:18.299510 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:51:18.606115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:51:19.829292 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:51:19.829396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:51:19.829524 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:51:19.830802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:51:19.831644 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:51:19.831962 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:51:19.832183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:51:20.152603 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:51:48.865035 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:51:48.865156 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:51:48.865258 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:51:48.865344 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:51:48.865425 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:51:48.865503 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:51:48.865582 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:51:49.173029 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:51:50.421121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:51:50.421213 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:51:50.421292 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:51:50.421372 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:51:50.421444 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:51:50.421517 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:51:50.421594 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:51:50.733201 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:52:04.061532 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:52:04.061615 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:52:04.061680 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:52:04.061753 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:52:04.061818 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:52:04.061883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:52:04.061950 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:52:04.370286 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:52:19.434177 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:52:19.434279 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:52:19.434360 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:52:19.434438 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:52:19.434506 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:52:19.434585 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:52:19.434665 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:52:19.740992 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:52:20.994728 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:52:20.994824 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:52:20.994895 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:52:20.994973 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:52:20.995052 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:52:20.995125 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:52:20.995196 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:52:21.294611 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:52:50.013500 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:52:50.013614 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:52:50.013702 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:52:50.013795 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:52:50.013873 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:52:50.013961 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:52:50.014042 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:52:50.320878 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:52:51.564377 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:52:51.564483 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:52:51.564555 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:52:51.564626 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:52:51.564707 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:52:51.564780 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:52:51.564853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:52:51.877468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:53:04.186428 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:53:04.186505 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:53:04.186583 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:53:04.186646 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:53:04.186714 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:53:04.186787 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:53:04.186855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:53:04.489790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:53:20.586198 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:53:20.586289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:53:20.586357 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:53:20.586419 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:53:20.586479 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:53:20.586540 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:53:20.586598 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:53:20.888570 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:53:22.147979 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:53:22.148059 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:53:22.148120 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:53:22.148184 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:53:22.148251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:53:22.148316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:53:22.148383 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:53:22.454572 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:53:51.154749 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:53:51.154952 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:53:51.155104 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:53:51.155331 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:53:51.156046 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:53:51.156710 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:53:51.156891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:53:51.460033 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:53:52.714909 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:53:52.715003 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:53:52.715065 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:53:52.715137 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:53:52.715200 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:53:52.715264 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:53:52.715325 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:53:53.016375 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:54:04.313283 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:54:04.313370 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:54:04.313436 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:54:04.313507 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:54:04.313569 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:54:04.313637 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:54:04.313701 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:54:04.631409 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:54:21.724478 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:54:21.724558 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:54:21.724623 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:54:21.724693 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:54:21.724764 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:54:21.724832 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:54:21.724899 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:54:22.048809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:54:23.272092 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:54:23.272180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:54:23.272247 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:54:23.272312 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:54:23.272377 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:54:23.272446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:54:23.272509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:54:23.581667 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:54:52.329578 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:54:52.329670 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:54:52.329737 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:54:52.329801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:54:52.329862 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:54:52.329925 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:54:52.329987 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:54:52.644399 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:54:53.838984 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:54:53.839101 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:54:53.839170 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:54:53.839237 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:54:53.839310 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:54:53.839391 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:54:53.839467 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:54:54.149775 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:55:04.433065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:55:04.433148 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:55:04.433216 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:55:04.433281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:55:04.433355 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:55:04.433431 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:55:04.433505 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:55:04.740620 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:55:22.908034 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:55:22.908123 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:55:22.908187 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:55:22.908254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:55:22.908318 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:55:22.908382 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:55:22.908444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:55:23.219671 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:55:24.413627 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:55:24.413709 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:55:24.413797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:55:24.413861 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:55:24.413924 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:55:24.413990 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:55:24.414055 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:55:24.730551 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:55:53.480234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:55:53.480317 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:55:53.480388 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:55:53.480465 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:55:53.480520 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:55:53.480590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:55:53.480653 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:55:53.786235 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:55:54.990639 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:55:54.990727 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:55:54.990809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:55:54.990877 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:55:54.990945 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:55:54.991027 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:55:54.991091 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:55:55.305132 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:56:04.560283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:56:04.560379 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:56:04.560475 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:56:04.560570 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:56:04.560664 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:56:04.560764 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:56:04.560838 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:56:04.883685 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:56:24.051946 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:56:24.052026 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:56:24.052090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:56:24.052151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:56:24.052210 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:56:24.052269 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:56:24.052329 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:56:24.360196 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:56:25.568605 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:56:25.568703 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:56:25.568795 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:56:25.568860 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:56:25.568932 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:56:25.569000 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:56:25.569071 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:56:25.875565 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:56:54.618385 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:56:54.618486 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:56:54.618550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:56:54.618628 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:56:54.618689 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:56:54.618760 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:56:54.618822 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:56:54.922039 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:56:56.136942 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:56:56.137029 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:56:56.137093 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:56:56.137157 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:56:56.137218 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:56:56.137284 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:56:56.137338 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:56:56.439993 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:57:04.675580 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:57:04.675672 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:57:04.675742 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:57:04.675820 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:57:04.675890 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:57:04.675947 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:57:04.676008 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:57:04.982881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:57:25.192001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:57:25.192086 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:57:25.192163 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:57:25.192233 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:57:25.192298 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:57:25.192364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:57:25.192426 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:57:25.496073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:57:26.698749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:57:26.698831 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:57:26.698904 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:57:26.698965 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:57:26.699027 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:57:26.699090 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:57:26.699155 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:57:27.017312 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:57:55.761582 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:57:55.761706 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:57:55.761782 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:57:55.761848 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:57:55.761915 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:57:55.761984 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:57:55.762042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:57:56.073877 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:57:57.280931 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:57:57.281018 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:57:57.281079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:57:57.281143 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:57:57.281201 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:57:57.281262 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:57:57.281323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:57:57.597818 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:58:04.798722 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:58:04.798799 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:58:04.798866 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:58:04.798930 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:58:04.798991 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:58:04.799057 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:58:04.799125 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:58:05.105120 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:58:26.340397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:58:26.341658 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:58:26.341813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:58:26.341912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:58:26.342000 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:58:26.342142 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:58:26.342251 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:58:26.648110 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:58:27.867761 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:58:27.867854 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:58:27.867937 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:58:27.868005 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:58:27.868070 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:58:27.868140 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:58:27.868220 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:58:28.175419 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:58:56.908756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:58:56.908859 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:58:56.908925 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:58:56.908992 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:58:56.909072 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:58:56.909141 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:58:56.909204 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:58:57.223154 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:58:58.441889 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:58:58.441979 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:58:58.442047 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:58:58.442121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:58:58.442182 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:58:58.442246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:58:58.442300 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:58:58.751833 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:59:04.922131 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:59:04.922210 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:59:04.922285 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:59:04.922357 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:59:04.922416 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:59:04.922476 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:59:04.922540 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:59:05.230900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:59:27.485867 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:59:27.485956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:59:27.486016 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:59:27.486087 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:59:27.486153 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:59:27.486229 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:59:27.486290 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:59:27.789637 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:59:29.020571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:59:29.020668 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:59:29.020751 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:59:29.020817 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:59:29.020888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:59:29.020949 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:59:29.021031 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:59:29.331700 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:59:58.050307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:59:58.050394 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:59:58.050471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:59:58.050536 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:59:58.050600 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:59:58.050670 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:59:58.050739 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:59:58.351619 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 02:59:59.600883 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 02:59:59.601006 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 02:59:59.601085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 02:59:59.601164 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 02:59:59.601240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 02:59:59.601341 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 02:59:59.601416 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 02:59:59.909297 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:00:05.047988 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:00:05.048101 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:00:05.048178 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:00:05.048264 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:00:05.048346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:00:05.048426 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:00:05.048499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:00:05.362896 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:00:28.614075 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:00:28.614205 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:00:28.614276 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:00:28.614341 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:00:28.614396 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:00:28.614463 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:00:28.614525 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:00:28.941079 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:00:30.169131 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:00:30.169212 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:00:30.169286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:00:30.169344 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:00:30.169407 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:00:30.169470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:00:30.169531 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:00:30.474101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:00:59.207249 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:00:59.207345 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:00:59.207417 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:00:59.207492 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:00:59.207561 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:00:59.207638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:00:59.207707 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:00:59.513402 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:01:00.739834 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:01:00.739915 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:01:00.739983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:01:00.740048 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:01:00.740110 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:01:00.740173 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:01:00.740236 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:01:01.039867 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:01:05.176509 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:01:05.176592 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:01:05.176663 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:01:05.176753 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:01:05.176812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:01:05.176879 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:01:05.176961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:01:05.488462 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:01:29.780028 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:01:29.780111 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:01:29.780187 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:01:29.780250 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:01:29.780323 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:01:29.780382 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:01:29.780451 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:01:30.093482 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:01:31.303623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:01:31.303748 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:01:31.303816 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:01:31.303880 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:01:31.303942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:01:31.304010 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:01:31.304065 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:01:31.603692 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:02:00.364974 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:02:00.365083 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:02:00.365155 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:02:00.365222 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:02:00.365285 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:02:00.365365 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:02:00.365434 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:02:00.677149 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:02:01.873896 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:02:01.874005 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:02:01.874075 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:02:01.874138 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:02:01.874205 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:02:01.874270 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:02:01.874333 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:02:02.189227 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:02:05.302879 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:02:05.302951 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:02:05.303020 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:02:05.303085 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:02:05.303152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:02:05.303211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:02:05.303273 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:02:05.611139 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:02:30.936532 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:02:30.936618 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:02:30.936687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:02:30.936762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:02:30.936828 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:02:30.936891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:02:30.936955 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:02:31.248124 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:02:32.453082 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:02:32.453183 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:02:32.453249 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:02:32.453311 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:02:32.453372 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:02:32.453444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:02:32.453506 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:02:32.758621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:03:01.504884 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:03:01.504968 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:03:01.505042 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:03:01.505103 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:03:01.505171 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:03:01.505239 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:03:01.505301 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:03:01.819211 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:03:03.023381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:03:03.023469 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:03:03.023551 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:03:03.023619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:03:03.023683 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:03:03.023776 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:03:03.023853 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:03:03.326152 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:03:05.434080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:03:05.434154 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:03:05.434222 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:03:05.434286 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:03:05.434353 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:03:05.434415 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:03:05.434483 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:03:05.741140 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:03:32.099857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:03:32.099955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:03:32.100020 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:03:32.100091 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:03:32.100156 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:03:32.100227 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:03:32.100292 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:03:32.407952 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:03:33.589223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:03:33.589322 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:03:33.589405 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:03:33.589473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:03:33.589538 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:03:33.589607 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:03:33.589675 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:03:33.898738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:04:02.674657 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:04:02.674755 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:04:02.674819 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:04:02.674878 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:04:02.674943 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:04:02.675007 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:04:02.675069 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:04:02.982485 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:04:04.157986 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:04:04.158070 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:04:04.158136 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:04:04.158199 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:04:04.158261 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:04:04.158325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:04:04.158391 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:04:04.461751 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:04:05.563135 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:04:05.563217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:04:05.563285 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:04:05.563356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:04:05.563422 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:04:05.563527 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:04:05.563609 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:04:05.875616 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:04:33.240338 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:04:33.240440 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:04:33.240507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:04:33.240571 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:04:33.240635 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:04:33.240701 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:04:33.240764 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:04:33.552223 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:04:34.733883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:04:34.733967 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:04:34.734040 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:04:34.734103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:04:34.734168 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:04:34.734238 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:04:34.734299 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:04:35.047819 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:05:03.811121 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:05:03.811210 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:05:03.811273 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:05:03.811338 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:05:03.811400 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:05:03.811464 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:05:03.811526 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:05:04.116796 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:05:05.310295 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:05:05.310407 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:05:05.310484 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:05:05.310547 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:05:05.310609 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:05:05.310671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:05:05.310737 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:05:05.618219 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:05:05.882973 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:05:05.883064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:05:05.883149 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:05:05.883222 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:05:05.883290 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:05:05.883367 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:05:05.883433 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:05:06.180457 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:05:34.387510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:05:34.387604 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:05:34.387707 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:05:34.387780 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:05:34.387856 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:05:34.387929 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:05:34.387993 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:05:34.684740 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:05:35.884380 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:05:35.884499 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:05:35.884582 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:05:35.884673 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:05:35.884766 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:05:35.884850 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:05:35.884931 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:05:36.190952 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:06:04.944700 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:06:04.944814 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:06:04.944883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:06:04.944966 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:06:04.945032 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:06:04.945103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:06:04.945172 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:06:05.250275 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:06:05.812071 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:06:05.812171 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:06:05.812253 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:06:05.812340 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:06:05.812415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:06:05.812494 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:06:05.812568 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:06:06.114074 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:06:06.453511 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:06:06.453609 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:06:06.453686 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:06:06.453765 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:06:06.453835 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:06:06.453912 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:06:06.453985 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:06:06.757801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:06:35.511826 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:06:35.511919 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:06:35.511985 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:06:35.512046 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:06:35.512123 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:06:35.512187 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:06:35.512252 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:06:35.825164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:06:37.018966 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:06:37.019066 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:06:37.019155 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:06:37.019233 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:06:37.019313 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:06:37.019401 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:06:37.019481 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:06:37.317020 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:07:05.942966 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:07:05.943057 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:07:05.943138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:07:05.943217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:07:05.943301 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:07:05.943378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:07:05.943453 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:07:06.240929 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:07:06.503845 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:07:06.503941 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:07:06.504016 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:07:06.504087 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:07:06.504157 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:07:06.504231 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:07:06.504299 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:07:06.812091 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:07:07.571613 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:07:07.571733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:07:07.571805 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:07:07.571870 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:07:07.571931 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:07:07.572001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:07:07.572057 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:07:07.880664 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:07:36.505619 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:07:36.505756 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:07:36.505839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:07:36.505923 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:07:36.505993 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:07:36.506073 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:07:36.506151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:07:36.811484 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:07:38.142843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:07:38.143075 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:07:38.143468 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:07:38.143860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:07:38.144606 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:07:38.144728 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:07:38.144847 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:07:38.443343 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:08:06.072061 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:08:06.072154 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:08:06.072232 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:08:06.072317 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:08:06.072393 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:08:06.072469 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:08:06.072544 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:08:06.372948 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:08:07.072608 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:08:07.072700 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:08:07.072799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:08:07.072879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:08:07.072955 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:08:07.073031 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:08:07.073115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:08:07.371784 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:08:08.704436 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:08:08.704528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:08:08.704605 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:08:08.704674 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:08:08.704746 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:08:08.704816 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:08:08.704888 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:08:09.007621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:08:37.635358 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:08:37.635485 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:08:37.635572 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:08:37.635655 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:08:37.635730 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:08:37.635808 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:08:37.635875 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:08:37.937500 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:08:39.277531 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:08:39.277649 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:08:39.277748 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:08:39.277844 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:08:39.277918 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:08:39.277994 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:08:39.278077 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:08:39.578002 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:09:06.200500 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:09:06.200579 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:09:06.200647 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:09:06.200714 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:09:06.200791 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:09:06.200849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:09:06.200919 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:09:06.509268 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:09:08.199628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:09:08.199726 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:09:08.199791 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:09:08.199855 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:09:08.199924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:09:08.199988 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:09:08.200053 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:09:08.504645 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:09:09.832591 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:09:09.832676 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:09:09.832747 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:09:09.832815 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:09:09.832880 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:09:09.832946 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:09:09.833006 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:09:10.143184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:09:38.771269 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:09:38.771355 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:09:38.771425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:09:38.771491 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:09:38.771552 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:09:38.771614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:09:38.771678 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:09:39.077249 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:09:40.405975 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:09:40.406063 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:09:40.406130 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:09:40.406199 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:09:40.406260 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:09:40.406325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:09:40.406391 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:09:40.716846 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:10:06.331283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:10:06.331633 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:10:06.332009 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:10:06.332230 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:10:06.332721 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:10:06.332808 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:10:06.332891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:10:06.642589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:10:09.345451 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:10:09.345568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:10:09.345645 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:10:09.345740 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:10:09.345811 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:10:09.345890 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:10:09.345959 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:10:09.654883 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:10:10.981660 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:10:10.981751 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:10:10.981826 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:10:10.981888 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:10:10.981953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:10:10.982014 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:10:10.982080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:10:11.282467 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:10:39.919019 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:10:39.919110 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:10:39.919179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:10:39.919249 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:10:39.919323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:10:39.919387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:10:39.919449 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:10:40.234739 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:10:41.550688 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:10:41.550810 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:10:41.550894 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:10:41.550970 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:10:41.551049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:10:41.551133 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:10:41.551224 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:10:41.853124 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:11:06.462391 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:11:06.462538 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:11:06.462653 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:11:06.462752 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:11:06.462864 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:11:06.462956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:11:06.463059 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:11:06.769758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:11:10.492221 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:11:10.492331 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:11:10.492423 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:11:10.492515 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:11:10.492624 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:11:10.492731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:11:10.492837 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:11:10.811081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:11:12.124603 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:11:12.124683 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:11:12.124768 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:11:12.124840 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:11:12.124908 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:11:12.124973 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:11:12.125040 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:11:12.438980 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:11:41.093652 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:11:41.093763 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:11:41.093830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:11:41.093923 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:11:41.093986 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:11:41.094054 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:11:41.094119 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:11:41.398004 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:11:42.702122 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:11:42.702226 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:11:42.702290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:11:42.702375 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:11:42.702436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:11:42.702512 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:11:42.702574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:11:43.006889 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:12:06.588363 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:12:06.588439 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:12:06.588509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:12:06.588576 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:12:06.588642 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:12:06.588702 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:12:06.588769 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:12:06.896552 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:12:11.663467 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:12:11.663563 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:12:11.663631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:12:11.663727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:12:11.663792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:12:11.663871 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:12:11.663938 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:12:11.985463 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:12:13.277795 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:12:13.277915 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:12:13.277999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:12:13.278077 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:12:13.278150 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:12:13.278209 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:12:13.278280 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:12:13.583751 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:12:42.273988 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:12:42.274080 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:12:42.274149 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:12:42.274216 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:12:42.274282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:12:42.274344 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:12:42.274409 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:12:42.579371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:12:43.843310 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:12:43.843389 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:12:43.843457 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:12:43.843528 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:12:43.843592 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:12:43.843657 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:12:43.843729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:12:44.146707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:13:06.716698 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:13:06.716788 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:13:06.716855 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:13:06.716921 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:13:06.716980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:13:06.717041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:13:06.717104 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:13:07.022345 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:13:12.841624 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:13:12.841708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:13:12.841779 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:13:12.841851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:13:12.841914 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:13:12.841975 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:13:12.842034 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:13:13.148572 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:13:14.417932 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:13:14.418021 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:13:14.418086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:13:14.418151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:13:14.418257 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:13:14.419103 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:13:14.419319 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:13:14.727577 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:13:43.411045 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:13:43.411125 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:13:43.411207 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:13:43.411270 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:13:43.411331 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:13:43.411395 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:13:43.411465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:13:43.718006 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:13:44.990738 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:13:44.990824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:13:44.990891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:13:44.990957 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:13:44.991020 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:13:44.991084 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:13:44.991147 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:13:45.299434 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:14:06.844715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:14:06.844799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:14:06.844875 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:14:06.844952 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:14:06.845019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:14:06.845084 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:14:06.845154 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:14:07.155613 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:14:13.982801 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:14:13.982889 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:14:13.982954 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:14:13.983015 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:14:13.983076 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:14:13.983137 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:14:13.983199 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:14:14.291081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:14:15.562918 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:14:15.563002 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:14:15.563095 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:14:15.563159 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:14:15.563226 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:14:15.563301 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:14:15.563358 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:14:15.875394 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:14:44.557413 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:14:44.557524 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:14:44.557602 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:14:44.558537 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:14:44.558797 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:14:44.559069 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:14:44.560387 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:14:44.879725 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:14:46.131618 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:14:46.131699 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:14:46.131766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:14:46.131830 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:14:46.131893 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:14:46.131960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:14:46.132020 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:14:46.440856 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:15:06.970389 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:15:06.970501 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:15:06.970579 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:15:06.970665 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:15:06.970743 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:15:06.970820 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:15:06.970900 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:15:07.279914 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:15:15.140211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:15:15.140321 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:15:15.140393 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:15:15.140468 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:15:15.140538 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:15:15.140624 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:15:15.140695 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:15:15.441565 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:15:16.703016 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:15:16.703104 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:15:16.703172 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:15:16.703248 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:15:16.703314 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:15:16.703372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:15:16.703436 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:15:17.008972 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:15:45.701206 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:15:45.701301 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:15:45.701366 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:15:45.701429 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:15:45.701490 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:15:45.701549 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:15:45.701612 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:15:46.019187 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:15:47.273941 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:15:47.274026 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:15:47.274099 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:15:47.274167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:15:47.274237 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:15:47.274307 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:15:47.274396 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:15:47.577433 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:16:07.098480 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:16:07.098568 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:16:07.098633 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:16:07.098700 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:16:07.098767 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:16:07.098829 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:16:07.098896 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:16:07.405228 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:16:16.290259 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:16:16.290371 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:16:16.290442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:16:16.290513 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:16:16.290583 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:16:16.290655 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:16:16.290725 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:16:16.593090 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:16:17.850083 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:16:17.850173 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:16:17.850239 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:16:17.850308 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:16:17.850380 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:16:17.850446 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:16:17.850512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:16:18.156077 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:16:46.854272 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:16:46.854353 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:16:46.854421 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:16:46.854490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:16:46.854562 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:16:46.854622 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:16:46.854687 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:16:47.171789 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:16:48.414970 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:16:48.415067 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:16:48.415146 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:16:48.415212 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:16:48.415278 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:16:48.415343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:16:48.415399 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:16:48.721734 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:17:07.224056 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:17:07.224135 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:17:07.224204 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:17:07.224274 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:17:07.224332 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:17:07.224395 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:17:07.224460 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:17:07.529071 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:17:17.431994 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:17:17.432097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:17:17.432181 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:17:17.432246 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:17:17.432317 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:17:17.432384 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:17:17.432452 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:17:17.749306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:17:18.982701 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:17:18.982794 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:17:18.982854 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:17:18.982931 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:17:18.982993 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:17:18.983058 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:17:18.983114 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:17:19.296822 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:17:48.016577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:17:48.016660 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:17:48.016729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:17:48.016798 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:17:48.016862 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:17:48.016935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:17:48.016996 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:17:48.323951 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:17:49.560842 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:17:49.560924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:17:49.561016 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:17:49.561086 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:17:49.561149 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:17:49.561209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:17:49.561266 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:17:49.876469 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:18:07.354693 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:18:07.354832 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:18:07.354924 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:18:07.355001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:18:07.355074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:18:07.355151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:18:07.355229 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:18:07.663808 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:18:18.589015 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:18:18.589122 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:18:18.589195 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:18:18.589257 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:18:18.589319 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:18:18.589382 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:18:18.589453 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:18:18.897392 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:18:20.141202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:18:20.141283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:18:20.141359 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:18:20.141420 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:18:20.141491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:18:20.141555 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:18:20.141634 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:18:20.444511 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:18:49.159583 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:18:49.159672 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:18:49.159746 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:18:49.159830 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:18:49.159894 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:18:49.159961 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:18:49.160020 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:18:49.463340 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:18:50.709223 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:18:50.709307 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:18:50.709373 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:18:50.709434 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:18:50.709504 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:18:50.709568 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:18:50.709635 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:18:51.010153 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:19:07.478593 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:19:07.478673 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:19:07.478757 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:19:07.478823 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:19:07.478890 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:19:07.478953 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:19:07.479014 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:19:07.791051 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:19:19.722646 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:19:19.722746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:19:19.722822 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:19:19.722891 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:19:19.722962 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:19:19.723041 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:19:19.723113 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:19:20.037003 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:19:21.271738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:19:21.271837 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:19:21.271907 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:19:21.271974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:19:21.272038 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:19:21.272108 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:19:21.272170 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:19:21.575584 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:19:50.306600 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:19:50.306689 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:19:50.306767 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:19:50.306834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:19:50.306894 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:19:50.306957 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:19:50.307018 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:19:50.615821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:19:51.843795 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:19:51.843885 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:19:51.843968 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:19:51.844038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:19:51.844121 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:19:51.844202 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:19:51.844286 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:19:52.164951 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:20:07.603638 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:20:07.603750 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:20:07.603829 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:20:07.603899 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:20:07.603969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:20:07.604038 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:20:07.604109 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:20:07.914770 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:20:20.879704 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:20:20.879816 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:20:20.879890 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:20:20.879960 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:20:20.880028 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:20:20.880099 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:20:20.880164 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:20:21.187224 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:20:22.433205 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:20:22.433299 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:20:22.433366 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:20:22.433438 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:20:22.433506 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:20:22.433586 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:20:22.433660 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:20:22.743676 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:20:51.452675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:20:51.452771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:20:51.452836 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:20:51.452902 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:20:51.452973 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:20:51.453040 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:20:51.453097 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:20:51.762503 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:20:53.009792 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:20:53.009895 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:20:53.009956 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:20:53.010021 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:20:53.010081 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:20:53.010145 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:20:53.010206 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:20:53.317922 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:21:07.726133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:21:07.726234 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:21:07.726308 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:21:07.726378 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:21:07.726454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:21:07.726522 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:21:07.726595 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:21:08.038235 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:21:22.030307 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:21:22.030388 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:21:22.030456 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:21:22.030532 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:21:22.030597 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:21:22.030655 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:21:22.030730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:21:22.348554 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:21:23.582259 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:21:23.582352 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:21:23.582418 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:21:23.582480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:21:23.582549 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:21:23.582612 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:21:23.582675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:21:23.893356 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:21:52.619971 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:21:52.620050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:21:52.620123 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:21:52.620188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:21:52.620250 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:21:52.620311 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:21:52.620378 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:21:52.926025 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:21:54.159660 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:21:54.159751 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:21:54.159813 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:21:54.159879 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:21:54.159944 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:21:54.160009 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:21:54.160070 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:21:54.467373 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:22:07.857808 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:22:07.857897 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:22:07.857992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:22:07.858065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:22:07.858130 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:22:07.858200 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:22:07.858271 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:22:08.171583 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:22:23.190271 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:22:23.190350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:22:23.190419 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:22:23.190488 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:22:23.190552 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:22:23.190609 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:22:23.190676 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:22:23.495926 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:22:24.728209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:22:24.728290 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:22:24.728364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:22:24.728428 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:22:24.728498 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:22:24.728563 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:22:24.728625 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:22:25.042922 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:22:53.761657 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:22:53.761737 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:22:53.761809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:22:53.761871 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:22:53.761937 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:22:53.762000 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:22:53.762060 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:22:54.066694 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:22:55.308073 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:22:55.308155 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:22:55.308217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:22:55.308282 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:22:55.308342 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:22:55.308399 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:22:55.308461 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:22:55.613483 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:23:07.985189 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:23:07.985277 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:23:07.985342 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:23:07.985407 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:23:07.985475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:23:07.985538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:23:07.985600 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:23:08.290420 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:23:24.328267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:23:24.328346 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:23:24.328428 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:23:24.328491 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:23:24.328562 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:23:24.328625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:23:24.328687 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:23:24.641210 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:23:25.877164 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:23:25.877251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:23:25.877315 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:23:25.877400 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:23:25.877464 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:23:25.877538 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:23:25.877613 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:23:26.180403 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:23:54.917677 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:23:54.917987 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:23:54.918660 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:23:54.918786 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:23:54.918876 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:23:54.918948 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:23:54.919024 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:23:55.233502 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:23:56.443199 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:23:56.443289 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:23:56.443362 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:23:56.443429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:23:56.443497 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:23:56.443576 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:23:56.443641 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:23:56.757177 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:24:08.115665 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:24:08.115756 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:24:08.115823 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:24:08.115879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:24:08.115957 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:24:08.116016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:24:08.116082 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:24:08.426703 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:24:25.492909 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:24:25.492989 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:24:25.493067 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:24:25.493128 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:24:25.493192 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:24:25.493257 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:24:25.493324 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:24:25.794842 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:24:27.022491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:24:27.022575 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:24:27.022642 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:24:27.022705 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:24:27.022775 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:24:27.022840 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:24:27.022906 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:24:27.333966 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:24:56.057227 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:24:56.057339 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:24:56.057403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:24:56.057464 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:24:56.057524 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:24:56.057589 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:24:56.057651 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:24:56.365093 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:24:57.591896 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:24:57.591987 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:24:57.592052 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:24:57.592131 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:24:57.592197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:24:57.592283 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:24:57.592366 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:24:57.892714 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:25:08.248436 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:25:08.248535 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:25:08.248619 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:25:08.248705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:25:08.248811 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:25:08.248887 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:25:08.248962 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:25:08.556113 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:25:26.625729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:25:26.625846 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:25:26.625925 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:25:26.626007 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:25:26.626081 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:25:26.626167 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:25:26.626239 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:25:26.936868 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:25:28.155409 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:25:28.155498 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:25:28.155577 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:25:28.155647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:25:28.155726 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:25:28.155804 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:25:28.155878 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:25:28.460424 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:25:57.199960 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:25:57.200065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:25:57.200152 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:25:57.200223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:25:57.200301 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:25:57.200370 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:25:57.200446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:25:57.511702 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:25:58.720248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:25:58.720335 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:25:58.720413 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:25:58.720491 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:25:58.720567 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:25:58.720635 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:25:58.720711 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:25:59.029916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:26:08.379526 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:26:08.380642 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:26:08.380885 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:26:08.381084 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:26:08.381487 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:26:08.381776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:26:08.381958 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:26:08.688932 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:26:27.776857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:26:27.776967 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:26:27.777032 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:26:27.777094 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:26:27.777168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:26:27.777234 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:26:27.777302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:26:28.087876 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:26:29.292690 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:26:29.292783 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:26:29.292854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:26:29.292915 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:26:29.292981 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:26:29.293051 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:26:29.293134 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:26:29.606191 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:26:58.349085 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:26:58.349177 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:26:58.349246 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:26:58.349307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:26:58.349367 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:26:58.349431 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:26:58.349494 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:26:58.652093 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:26:59.881468 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:26:59.881552 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:26:59.881622 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:26:59.881680 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:26:59.881753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:26:59.881822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:26:59.881883 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:27:00.184097 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:27:08.506661 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:27:08.506747 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:27:08.506825 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:27:08.506899 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:27:08.506967 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:27:08.507040 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:27:08.507106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:27:08.818535 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:27:28.931016 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:27:28.931111 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:27:28.931206 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:27:28.931298 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:27:28.931371 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:27:28.931447 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:27:28.931522 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:27:29.247119 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:27:30.444584 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:27:30.444681 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:27:30.444775 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:27:30.444859 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:27:30.444932 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:27:30.445013 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:27:30.445087 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:27:30.739779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:27:59.509405 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:27:59.509499 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:27:59.509583 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:27:59.509659 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:27:59.509749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:27:59.509820 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:27:59.509899 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:27:59.810997 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:28:01.001634 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:28:01.001754 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:28:01.001827 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:28:01.001894 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:28:01.001976 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:28:01.002042 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:28:01.002118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:28:01.307347 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:28:08.634030 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:28:08.634107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:28:08.634176 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:28:08.634243 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:28:08.634321 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:28:08.634385 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:28:08.634448 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:28:08.941191 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:28:30.090665 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:28:30.090835 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:28:30.090953 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:28:30.091083 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:28:30.091773 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:28:30.092226 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:28:30.092811 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:28:30.397563 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:28:31.569054 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:28:31.569138 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:28:31.569209 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:28:31.569274 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:28:31.569340 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:28:31.569405 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:28:31.569478 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:28:31.871935 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:29:00.658789 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:29:00.658872 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:29:00.658950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:29:00.659017 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:29:00.659077 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:29:00.659143 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:29:00.659209 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:29:00.970776 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:29:02.140293 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:29:02.140395 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:29:02.140477 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:29:02.140557 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:29:02.140638 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:29:02.140714 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:29:02.140805 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:29:02.447220 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:29:08.758788 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:29:08.758879 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:29:08.758958 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:29:08.759032 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:29:08.759112 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:29:08.759190 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:29:08.759268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:29:09.059854 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:29:31.235162 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:29:31.235276 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:29:31.235349 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:29:31.235437 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:29:31.235508 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:29:31.235622 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:29:31.235703 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:29:31.544642 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:29:32.709310 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:29:32.709435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:29:32.709504 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:29:32.709579 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:29:32.709664 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:29:32.709740 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:29:32.709818 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:29:33.026497 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:30:01.827148 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:30:01.827230 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:30:01.827298 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:30:01.827369 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:30:01.827430 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:30:01.827496 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:30:01.827576 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:30:02.141189 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:30:03.294156 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:30:03.294249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:30:03.294326 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:30:03.294397 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:30:03.294466 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:30:03.294528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:30:03.294589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:30:03.601252 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:30:08.878456 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:30:08.878541 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:30:08.878605 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:30:08.878672 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:30:08.878744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:30:08.878806 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:30:08.878868 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:30:09.189341 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:30:32.418770 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:30:32.418846 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:30:32.418930 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:30:32.419000 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:30:32.419066 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:30:32.419124 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:30:32.419189 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:30:32.723672 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:30:33.864224 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:30:33.864309 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:30:33.864381 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:30:33.864445 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:30:33.864509 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:30:33.864578 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:30:33.864639 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:30:34.174425 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:31:02.988409 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:31:02.988491 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:31:02.988563 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:31:02.988627 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:31:02.988695 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:31:02.988769 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:31:02.988832 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:31:03.306307 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:31:04.431608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:31:04.431693 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:31:04.431781 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:31:04.431856 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:31:04.431924 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:31:04.431982 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:31:04.432047 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:31:04.734049 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:31:09.004736 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:31:09.004816 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:31:09.004878 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:31:09.004944 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:31:09.005006 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:31:09.005075 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:31:09.005136 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:31:09.318815 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:31:33.567533 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:31:33.567614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:31:33.567683 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:31:33.567749 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:31:33.567823 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:31:33.567886 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:31:33.567957 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:31:33.880773 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:31:35.004787 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:31:35.004871 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:31:35.004942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:31:35.005019 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:31:35.005078 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:31:35.005140 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:31:35.005201 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:31:35.311689 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:32:04.142428 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:32:04.143765 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:32:04.143864 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:32:04.143974 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:32:04.144041 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:32:04.144105 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:32:04.144168 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:32:04.451668 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:32:05.574695 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:32:05.574784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:32:05.574851 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:32:05.574917 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:32:05.574982 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:32:05.575045 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:32:05.575108 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:32:05.884430 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:32:09.126889 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:32:09.126973 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:32:09.127041 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:32:09.127103 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:32:09.127170 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:32:09.127226 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:32:09.127292 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:32:09.448537 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:32:34.719408 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:32:34.719497 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:32:34.719583 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:32:34.719646 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:32:34.719708 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:32:34.719772 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:32:34.719831 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:32:35.041885 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:32:36.139914 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:32:36.139999 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:32:36.140066 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:32:36.140150 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:32:36.140211 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:32:36.140269 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:32:36.140331 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:32:36.447329 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:33:05.305026 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:33:05.305105 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:33:05.305171 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:33:05.305238 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:33:05.305316 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:33:05.305381 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:33:05.305444 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:33:05.611377 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:33:06.715564 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:33:06.715786 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:33:06.716118 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:33:06.716367 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:33:06.716962 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:33:06.717608 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:33:06.717706 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:33:07.026832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:33:09.249261 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:33:09.249334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:33:09.249402 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:33:09.249471 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:33:09.249533 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:33:09.249593 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:33:09.249658 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:33:09.557817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:33:35.871128 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:33:35.871215 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:33:35.871290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:33:35.871362 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:33:35.871428 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:33:35.871487 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:33:35.871550 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:33:36.174660 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:33:37.285694 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:33:37.285783 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:33:37.285854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:33:37.285921 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:33:37.285981 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:33:37.286046 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:33:37.286105 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:33:37.586947 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:34:06.439895 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:34:06.439975 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:34:06.440052 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:34:06.440111 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:34:06.440173 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:34:06.440235 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:34:06.440300 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:34:06.747161 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:34:07.846590 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:34:07.846666 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:34:07.846749 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:34:07.846813 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:34:07.846881 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:34:07.846934 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:34:07.846992 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:34:08.158081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:34:09.372855 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:34:09.372934 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:34:09.373004 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:34:09.373064 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:34:09.373128 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:34:09.373187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:34:09.373244 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:34:09.686892 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:34:37.007906 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:34:37.007987 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:34:37.008068 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:34:37.008133 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:34:37.008192 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:34:37.008249 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:34:37.008316 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:34:37.317428 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:34:38.417886 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:34:38.417961 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:34:38.418024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:34:38.418089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:34:38.418157 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:34:38.418217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:34:38.418277 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:34:38.723455 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:35:07.580182 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:35:07.580268 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:35:07.580338 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:35:07.580398 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:35:07.580465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:35:07.580528 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:35:07.580595 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:35:07.887816 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:35:08.990131 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:35:08.990212 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:35:08.990279 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:35:08.990340 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:35:08.990404 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:35:08.990464 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:35:08.990527 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:35:09.303578 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:35:09.572049 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:35:09.572133 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:35:09.572199 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:35:09.572268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:35:09.572341 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:35:09.572413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:35:09.572477 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:35:09.878355 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:35:38.150550 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:35:38.150634 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:35:38.150700 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:35:38.150773 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:35:38.150841 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:35:38.150913 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:35:38.150980 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:35:38.456619 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:35:39.573697 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:35:39.573795 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:35:39.573861 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:35:39.573933 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:35:39.573997 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:35:39.574060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:35:39.574120 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:35:39.884827 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:36:08.715979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:36:08.716083 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:36:08.716151 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:36:08.716209 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:36:08.716267 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:36:08.716337 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:36:08.716397 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:36:09.025541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:36:09.616501 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:36:09.616585 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:36:09.616653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:36:09.616737 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:36:09.616802 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:36:09.616872 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:36:09.616942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:36:09.923150 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:36:10.189077 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:36:10.189160 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:36:10.189231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:36:10.189297 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:36:10.189360 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:36:10.189425 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:36:10.189490 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:36:10.492291 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:36:39.296177 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:36:39.296270 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:36:39.296342 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:36:39.296426 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:36:39.296502 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:36:39.296601 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:36:39.296662 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:36:39.597260 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:36:40.755164 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:36:40.755249 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:36:40.755311 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:36:40.755375 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:36:40.755444 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:36:40.755508 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:36:40.755569 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:36:41.058341 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:37:09.741048 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:37:09.741127 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:37:09.741189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:37:09.741250 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:37:09.741317 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:37:09.741379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:37:09.741450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:37:10.066862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:37:10.338842 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:37:10.338939 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:37:10.339007 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:37:10.339068 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:37:10.339136 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:37:10.339194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:37:10.339264 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:37:10.641155 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:37:11.319696 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:37:11.319801 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:37:11.319868 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:37:11.319934 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:37:11.319998 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:37:11.320057 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:37:11.320125 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:37:11.627057 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:37:40.339682 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:37:40.339812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:37:40.339881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:37:40.339947 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:37:40.340011 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:37:40.340072 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:37:40.340135 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:37:40.643866 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:37:41.901959 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:37:41.902058 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:37:41.902128 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:37:41.902204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:37:41.902285 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:37:41.902352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:37:41.902418 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:37:42.219194 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:38:09.860227 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:38:09.860302 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:38:09.860370 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:38:09.860433 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:38:09.860496 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:38:09.860555 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:38:09.860624 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:38:10.173488 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:38:10.914685 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:38:10.914772 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:38:10.914842 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:38:10.914906 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:38:10.914975 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:38:10.915036 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:38:10.915101 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:38:11.221337 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:38:12.482067 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:38:12.482174 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:38:12.482251 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:38:12.482318 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:38:12.482395 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:38:12.482461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:38:12.482534 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:38:12.793460 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:38:41.483944 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:38:41.484033 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:38:41.484106 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:38:41.484176 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:38:41.484240 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:38:41.484299 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:38:41.484359 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:38:41.787953 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:38:43.058460 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:38:43.058547 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:38:43.058632 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:38:43.058702 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:38:43.058776 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:38:43.058838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:38:43.058898 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:38:43.367229 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:39:09.982542 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:39:09.982618 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:39:09.982683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:39:09.982759 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:39:09.982821 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:39:09.982888 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:39:09.982948 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:39:10.300900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:39:12.050918 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:39:12.051007 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:39:12.051077 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:39:12.051148 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:39:12.051213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:39:12.051274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:39:12.051332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:39:12.357573 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:39:13.624827 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:39:13.624912 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:39:13.624975 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:39:13.625037 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:39:13.625101 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:39:13.625161 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:39:13.625223 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:39:13.935196 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:39:42.620435 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:39:42.620519 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:39:42.620603 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:39:42.620673 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:39:42.620747 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:39:42.620807 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:39:42.620868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:39:42.921665 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:39:44.197056 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:39:44.197135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:39:44.197203 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:39:44.197278 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:39:44.197349 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:39:44.197414 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:39:44.197478 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:39:44.504221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:40:10.103417 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:40:10.103496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:40:10.103557 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:40:10.103623 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:40:10.103679 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:40:10.103754 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:40:10.103820 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:40:10.412657 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:40:13.185855 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:40:13.185942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:40:13.186015 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:40:13.186078 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:40:13.186147 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:40:13.186213 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:40:13.186273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:40:13.489574 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:40:14.764343 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:40:14.764419 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:40:14.764483 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:40:14.764544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:40:14.764604 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:40:14.764666 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:40:14.764728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:40:15.071271 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:40:43.755872 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:40:43.755978 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:40:43.756043 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:40:43.756111 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:40:43.756169 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:40:43.756226 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:40:43.756288 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:40:44.071644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:40:45.334645 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:40:45.334744 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:40:45.334825 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:40:45.334902 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:40:45.334959 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:40:45.335029 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:40:45.335096 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:40:45.636615 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:41:10.226747 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:41:10.226833 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:41:10.226889 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:41:10.226958 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:41:10.227023 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:41:10.227924 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:41:10.228169 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:41:10.528496 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:41:14.339415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:41:14.339524 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:41:14.339592 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:41:14.339657 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:41:14.339729 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:41:14.339789 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:41:14.339856 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:41:14.651927 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:41:15.902984 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:41:15.903065 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:41:15.903138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:41:15.903201 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:41:15.903260 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:41:15.903321 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:41:15.903384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:41:16.210911 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:41:44.914861 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:41:44.914943 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:41:44.915008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:41:44.915071 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:41:44.915135 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:41:44.915200 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:41:44.915266 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:41:45.227388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:41:46.469635 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:41:46.469716 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:41:46.469788 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:41:46.469846 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:41:46.469909 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:41:46.469970 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:41:46.470041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:41:46.771387 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:42:10.353652 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:42:10.353741 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:42:10.353812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:42:10.353878 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:42:10.353941 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:42:10.354013 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:42:10.354076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:42:10.656133 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:42:15.486517 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:42:15.486631 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:42:15.486715 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:42:15.486810 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:42:15.486878 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:42:15.486953 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:42:15.487037 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:42:15.792578 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:42:17.039705 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:42:17.039797 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:42:17.039869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:42:17.039930 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:42:17.040003 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:42:17.040067 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:42:17.040122 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:42:17.339564 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:42:46.050817 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:42:46.050899 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:42:46.050976 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:42:46.051044 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:42:46.051106 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:42:46.051163 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:42:46.051227 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:42:46.354249 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:42:47.595367 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:42:47.595450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:42:47.595516 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:42:47.595579 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:42:47.595639 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:42:47.595701 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:42:47.595771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:42:47.903884 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:43:10.475302 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:43:10.475386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:43:10.475450 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:43:10.475518 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:43:10.475576 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:43:10.475646 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:43:10.475706 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:43:10.782429 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:43:16.615935 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:43:16.616045 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:43:16.616138 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:43:16.616219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:43:16.616305 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:43:16.616379 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:43:16.616463 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:43:16.934046 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:43:18.165541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:43:18.165940 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:43:18.166148 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:43:18.166884 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:43:18.166980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:43:18.167096 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:43:18.167199 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:43:18.470750 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:43:47.202192 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:43:47.202303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:43:47.202386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:43:47.202466 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:43:47.202550 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:43:47.202634 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:43:47.202712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:43:47.505695 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:43:48.736862 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:43:48.736974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:43:48.737058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:43:48.737127 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:43:48.737202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:43:48.737278 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:43:48.737351 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:43:49.042681 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:44:10.596984 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:44:10.597069 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:44:10.597144 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:44:10.597213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:44:10.597282 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:44:10.597354 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:44:10.597424 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:44:10.901269 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:44:17.777450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:44:17.777532 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:44:17.777601 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:44:17.777676 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:44:17.777746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:44:17.777815 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:44:17.777872 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:44:18.095836 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:44:19.305924 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:44:19.306005 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:44:19.306081 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:44:19.306150 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:44:19.306213 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:44:19.306277 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:44:19.306338 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:44:19.611860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:44:48.367454 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:44:48.367553 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:44:48.367643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:44:48.367749 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:44:48.367844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:44:48.367927 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:44:48.368020 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:44:48.674652 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:44:49.890230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:44:49.890325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:44:49.890399 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:44:49.890466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:44:49.890536 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:44:49.890606 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:44:49.890678 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:44:50.210033 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:45:10.718405 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:45:10.718507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:45:10.718581 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:45:10.718653 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:45:10.718729 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:45:10.718804 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:45:10.718868 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:45:11.039539 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:45:18.944254 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:45:18.944339 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:45:18.944406 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:45:18.944462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:45:18.944527 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:45:18.944588 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:45:18.944654 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:45:19.249693 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:45:20.477254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:45:20.477358 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:45:20.477436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:45:20.477522 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:45:20.477603 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:45:20.477685 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:45:20.477770 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:45:20.778430 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:45:49.513149 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:45:49.513235 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:45:49.513311 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:45:49.513383 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:45:49.513447 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:45:49.513511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:45:49.513582 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:45:49.818746 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:45:51.043121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:45:51.043208 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:45:51.043286 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:45:51.043359 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:45:51.043425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:45:51.043517 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:45:51.043605 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:45:51.346866 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:46:10.864392 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:46:10.864467 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:46:10.864535 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:46:10.864597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:46:10.864662 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:46:10.864729 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:46:10.864800 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:46:11.172648 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:46:20.090446 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:46:20.090541 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:46:20.090617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:46:20.090691 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:46:20.090780 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:46:20.090861 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:46:20.090929 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:46:20.408539 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:46:21.613202 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:46:21.613286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:46:21.613346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:46:21.613415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:46:21.613475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:46:21.613535 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:46:21.613600 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:46:21.926116 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:46:50.676533 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:46:50.676610 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:46:50.676684 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:46:50.676762 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:46:50.676834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:46:50.676898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:46:50.676965 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:46:50.984371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:46:52.215399 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:46:52.215506 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:46:52.215570 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:46:52.215631 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:46:52.215695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:46:52.215762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:46:52.215828 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:46:52.523096 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:47:10.974550 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:47:10.974644 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:47:10.974708 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:47:10.974779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:47:10.974839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:47:10.974903 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:47:10.974966 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:47:11.284382 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:47:21.251023 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:47:21.251116 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:47:21.251194 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:47:21.251267 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:47:21.251348 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:47:21.251418 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:47:21.251496 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:47:21.560882 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:47:22.792331 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:47:22.792443 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:47:22.792513 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:47:22.792585 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:47:22.792659 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:47:22.792747 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:47:22.792814 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:47:23.096227 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:47:51.823268 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:47:51.823359 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:47:51.823434 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:47:51.823499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:47:51.823563 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:47:51.823625 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:47:51.823693 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:47:52.138217 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:47:53.362292 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:47:53.362375 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:47:53.362468 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:47:53.362531 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:47:53.362594 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:47:53.362660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:47:53.362732 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:47:53.664221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:48:11.097144 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:48:11.097235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:48:11.097308 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:48:11.097386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:48:11.097452 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:48:11.097526 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:48:11.097598 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:48:11.402445 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:48:22.405346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:48:22.405470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:48:22.405539 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:48:22.405610 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:48:22.405681 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:48:22.405760 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:48:22.405841 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:48:22.711183 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:48:23.926484 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:48:23.926579 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:48:23.926657 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:48:23.926742 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:48:23.926841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:48:23.926912 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:48:23.926993 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:48:24.235521 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:48:52.972472 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:48:52.972579 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:48:52.972643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:48:52.972715 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:48:52.972793 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:48:52.972866 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:48:52.972933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:48:53.284901 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:48:54.494131 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:48:54.494233 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:48:54.494298 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:48:54.494357 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:48:54.494419 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:48:54.494484 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:48:54.494544 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:48:54.802781 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:49:11.222100 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:49:11.222545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:49:11.222625 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:49:11.222724 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:49:11.222800 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:49:11.222874 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:49:11.222952 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:49:11.531459 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:49:23.547873 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:49:23.547962 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:49:23.548034 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:49:23.548097 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:49:23.548159 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:49:23.548222 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:49:23.548283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:49:23.862503 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:49:25.068620 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:49:25.068698 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:49:25.068783 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:49:25.068850 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:49:25.068921 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:49:25.068981 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:49:25.069047 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:49:25.382011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:49:54.121596 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:49:54.121683 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:49:54.121749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:49:54.121814 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:49:54.121879 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:49:54.121944 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:49:54.122008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:49:54.440172 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:49:55.644035 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:49:55.644142 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:49:55.644207 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:49:55.644278 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:49:55.644343 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:49:55.644414 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:49:55.644474 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:49:55.959924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:50:11.343669 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:50:11.343760 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:50:11.343830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:50:11.343892 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:50:11.343957 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:50:11.344020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:50:11.344080 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:50:11.653070 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:50:24.703793 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:50:24.703915 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:50:24.704006 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:50:24.704108 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:50:24.705241 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:50:24.705500 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:50:24.705906 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:50:25.012861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:50:26.223287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:50:26.223402 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:50:26.223489 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:50:26.223588 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:50:26.223670 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:50:26.223758 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:50:26.223834 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:50:26.530050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:50:55.284295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:50:55.284402 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:50:55.284471 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:50:55.284545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:50:55.284614 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:50:55.284678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:50:55.284761 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:50:55.595251 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:50:56.789156 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:50:56.789246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:50:56.789309 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:50:56.789371 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:50:56.789434 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:50:56.789495 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:50:56.789552 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:50:57.092556 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:51:11.465252 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:51:11.465348 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:51:11.465435 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:51:11.465512 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:51:11.465587 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:51:11.465666 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:51:11.465751 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:51:11.773133 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:51:25.860370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:51:25.860487 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:51:25.860566 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:51:25.860648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:51:25.860740 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:51:25.860835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:51:25.860910 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:51:26.168029 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:51:27.354586 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:51:27.354684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:51:27.354763 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:51:27.354841 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:51:27.354907 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:51:27.354995 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:51:27.355068 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:51:27.661326 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:51:56.432299 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:51:56.432402 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:51:56.432468 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:51:56.432529 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:51:56.432612 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:51:56.432676 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:51:56.432748 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:51:56.745898 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:51:57.923106 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:51:57.923194 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:51:57.923258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:51:57.923328 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:51:57.923394 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:51:57.923455 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:51:57.923518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:51:58.230669 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:52:11.595851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:52:11.595932 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:52:11.595993 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:52:11.596061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:52:11.596118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:52:11.596184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:52:11.596244 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:52:11.905704 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:52:27.014301 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:52:27.014383 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:52:27.014464 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:52:27.014524 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:52:27.014581 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:52:27.014642 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:52:27.014706 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:52:27.327341 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:52:28.493802 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:52:28.493900 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:52:28.493964 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:52:28.494026 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:52:28.494100 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:52:28.494167 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:52:28.494230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:52:28.802747 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:52:57.588337 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:52:57.588431 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:52:57.588499 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:52:57.588566 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:52:57.588623 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:52:57.588687 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:52:57.588751 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:52:57.890436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:52:59.072670 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:52:59.072759 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:52:59.072826 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:52:59.072885 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:52:59.072963 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:52:59.073026 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:52:59.073094 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:52:59.386335 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:53:11.717966 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:53:11.718050 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:53:11.718120 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:53:11.718184 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:53:11.718254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:53:11.718317 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:53:11.718386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:53:12.028587 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:53:28.149049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:53:28.149131 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:53:28.149202 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:53:28.149267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:53:28.149327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:53:28.149391 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:53:28.149459 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:53:28.455902 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:53:29.647284 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:53:29.647362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:53:29.647438 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:53:29.647502 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:53:29.647559 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:53:29.647619 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:53:29.647681 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:53:29.954107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:53:58.715763 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:53:58.715972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:53:58.716797 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:53:58.717330 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:53:58.717441 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:53:58.717516 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:53:58.717585 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:53:59.028606 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:54:00.232627 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:54:00.232706 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:54:00.232793 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:54:00.232865 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:54:00.232926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:54:00.232991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:54:00.233051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:54:00.535918 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:54:11.837108 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:54:11.837178 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:54:11.837243 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:54:11.837304 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:54:11.837366 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:54:11.837426 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:54:11.837493 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:54:12.146379 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:54:29.297472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:54:29.297568 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:54:29.297638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:54:29.297702 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:54:29.297779 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:54:29.297841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:54:29.297906 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:54:29.603152 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:54:30.795976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:54:30.796055 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:54:30.796119 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:54:30.796187 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:54:30.796266 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:54:30.796333 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:54:30.796396 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:54:31.097882 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:54:59.868155 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:54:59.868237 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:54:59.868309 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:54:59.868372 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:54:59.868429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:54:59.868498 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:54:59.868567 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:55:00.177407 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:55:01.359235 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:55:01.359372 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:55:01.359445 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:55:01.359517 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:55:01.359587 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:55:01.359685 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:55:01.359756 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:55:01.662648 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:55:11.959266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:55:11.959347 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:55:11.959416 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:55:11.959480 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:55:11.959540 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:55:11.959609 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:55:11.959671 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:55:12.274164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:55:30.435767 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:55:30.435851 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:55:30.435921 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:55:30.435986 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:55:30.436060 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:55:30.436123 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:55:30.436186 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:55:30.741186 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:55:31.938180 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:55:31.938276 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:55:31.938337 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:55:31.938408 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:55:31.938467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:55:31.938528 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:55:31.938590 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:55:32.262701 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:56:01.002225 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:56:01.002309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:56:01.002377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:56:01.002438 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:56:01.002504 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:56:01.002562 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:56:01.002624 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:56:01.311991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:56:02.526609 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:56:02.526690 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:56:02.526764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:56:02.526827 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:56:02.526893 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:56:02.526953 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:56:02.527018 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:56:02.830785 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:56:12.080552 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:56:12.080632 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:56:12.080692 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:56:12.080777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:56:12.080844 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:56:12.080900 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:56:12.080967 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:56:12.398744 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:56:31.578313 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:56:31.578415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:56:31.578486 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:56:31.578551 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:56:31.578618 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:56:31.578695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:56:31.578771 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:56:31.885592 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:56:33.090156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:56:33.090237 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:56:33.090300 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:56:33.090365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:56:33.090433 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:56:33.090501 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:56:33.090577 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:56:33.400678 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:57:02.153385 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:57:02.153472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:57:02.153536 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:57:02.153611 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:57:02.153675 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:57:02.153756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:57:02.153827 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:57:02.464870 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:57:03.661422 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:57:03.661512 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:57:03.661586 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:57:03.661653 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:57:03.661724 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:57:03.661781 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:57:03.661842 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:57:03.963841 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:57:12.208923 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:57:12.209010 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:57:12.209087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:57:12.209155 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:57:12.209230 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:57:12.209297 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:57:12.209366 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:57:12.520029 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:57:32.728249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:57:32.728331 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:57:32.728401 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:57:32.728469 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:57:32.728532 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:57:32.728593 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:57:32.728654 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:57:33.039285 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:57:34.229973 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:57:34.230055 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:57:34.230136 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:57:34.230197 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:57:34.230262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:57:34.230322 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:57:34.230385 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:57:34.534685 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:58:03.301191 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:58:03.301269 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:58:03.301336 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:58:03.301400 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:58:03.301461 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:58:03.301520 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:58:03.301582 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:58:03.612049 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:58:04.790594 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:58:04.790675 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:58:04.790761 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:58:04.790823 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:58:04.790886 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:58:04.790947 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:58:04.791021 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:58:05.105245 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:58:12.333652 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:58:12.333729 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:58:12.333801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:58:12.333863 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:58:12.333933 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:58:12.333991 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:58:12.334051 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:58:12.641756 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:58:33.887218 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:58:33.887329 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:58:33.887407 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:58:33.887491 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:58:33.887561 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:58:33.887635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:58:33.887725 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:58:34.201057 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:58:35.368707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:58:35.368789 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:58:35.368857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:58:35.368922 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:58:35.368986 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:58:35.369049 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:58:35.369111 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:58:35.683733 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:59:04.485154 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:59:04.485239 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:59:04.485303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:59:04.485382 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:59:04.485445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:59:04.485511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:59:04.485569 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:59:04.799478 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:59:05.957534 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:59:05.957622 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:59:05.957692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:59:05.957763 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:59:05.957834 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:59:05.957899 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:59:05.957956 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:59:06.260101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:59:12.456923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:59:12.457009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:59:12.457078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:59:12.457145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:59:12.457212 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:59:12.457275 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:59:12.457341 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:59:12.768114 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:59:35.071085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:59:35.071208 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:59:35.071304 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:59:35.071406 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:59:35.071501 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:59:35.071578 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:59:35.071673 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:59:35.371662 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 03:59:36.522344 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 03:59:36.522445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 03:59:36.522521 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 03:59:36.522606 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 03:59:36.522709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 03:59:36.522801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 03:59:36.522939 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 03:59:36.824864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:00:05.632379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:00:05.632465 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:00:05.632535 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:00:05.632624 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:00:05.632696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:00:05.632780 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:00:05.632852 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:00:05.953699 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:00:07.091970 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:00:07.092070 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:00:07.092151 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:00:07.092217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:00:07.092290 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:00:07.092359 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:00:07.092431 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:00:07.393941 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:00:12.585057 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:00:12.585150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:00:12.585223 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:00:12.585290 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:00:12.585366 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:00:12.585434 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:00:12.585530 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:00:12.896319 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:00:36.215528 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:00:36.215627 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:00:36.215701 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:00:36.215784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:00:36.215855 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:00:36.215927 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:00:36.216005 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:00:36.517914 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:00:37.657090 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:00:37.657186 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:00:37.657268 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:00:37.657355 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:00:37.657433 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:00:37.657531 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:00:37.657614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:00:37.963348 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:01:06.794608 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:01:06.794705 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:01:06.794782 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:01:06.794858 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:01:06.794922 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:01:06.794992 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:01:06.795054 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:01:07.102406 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:01:08.219521 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:01:08.219607 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:01:08.219675 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:01:08.219748 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:01:08.219829 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:01:08.219897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:01:08.219962 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:01:08.527935 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:01:12.714874 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:01:12.714954 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:01:12.715023 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:01:12.715092 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:01:12.715161 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:01:12.715219 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:01:12.715274 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:01:13.018486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:01:37.364325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:01:37.364413 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:01:37.364479 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:01:37.364543 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:01:37.364608 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:01:37.364678 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:01:37.364742 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:01:37.680095 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:01:38.793907 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:01:38.793989 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:01:38.794057 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:01:38.794120 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:01:38.794182 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:01:38.794249 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:01:38.794316 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:01:39.095940 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:02:07.941661 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:02:07.941797 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:02:07.941883 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:02:07.941968 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:02:07.942046 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:02:07.942119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:02:07.942212 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:02:08.245669 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:02:09.364660 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:02:09.364767 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:02:09.364835 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:02:09.364898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:02:09.364971 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:02:09.365038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:02:09.365106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:02:09.666164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:02:12.843056 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:02:12.843149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:02:12.843215 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:02:12.843281 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:02:12.843352 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:02:12.843416 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:02:12.843483 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:02:13.149532 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:02:38.507436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:02:38.507522 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:02:38.507583 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:02:38.507647 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:02:38.507713 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:02:38.507784 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:02:38.507842 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:02:38.812933 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:02:39.939639 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:02:39.939729 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:02:39.939791 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:02:39.939861 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:02:39.939930 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:02:39.939988 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:02:39.940055 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:02:40.263983 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:03:09.080123 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:03:09.080232 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:03:09.080298 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:03:09.080370 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:03:09.080432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:03:09.080492 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:03:09.080563 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:03:09.400647 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:03:10.529705 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:03:10.529810 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:03:10.529906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:03:10.529990 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:03:10.530068 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:03:10.530145 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:03:10.530229 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:03:10.824263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:03:12.970919 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:03:12.971016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:03:12.971085 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:03:12.971154 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:03:12.971219 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:03:12.971282 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:03:12.971347 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:03:13.280731 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:03:39.660821 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:03:39.660921 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:03:39.661002 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:03:39.661094 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:03:39.661170 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:03:39.661260 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:03:39.661333 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:03:39.982689 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:03:41.078214 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:03:41.078323 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:03:41.078407 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:03:41.078483 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:03:41.078565 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:03:41.078631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:03:41.078710 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:03:41.376754 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:04:10.259375 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:04:10.259471 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:04:10.259534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:04:10.259602 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:04:10.259661 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:04:10.259734 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:04:10.259826 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:04:10.565924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:04:11.640217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:04:11.640296 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:04:11.640364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:04:11.640430 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:04:11.640494 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:04:11.640558 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:04:11.640621 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:04:11.949893 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:04:13.096624 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:04:13.097375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:04:13.098062 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:04:13.098746 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:04:13.099013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:04:13.099201 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:04:13.099532 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:04:13.408040 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:04:40.826404 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:04:40.826520 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:04:40.826589 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:04:40.826662 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:04:40.826729 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:04:40.826797 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:04:40.826870 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:04:41.134139 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:04:42.212194 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:04:42.212287 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:04:42.212358 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:04:42.212425 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:04:42.212487 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:04:42.212550 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:04:42.212608 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:04:42.517854 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:05:11.393795 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:05:11.393889 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:05:11.393960 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:05:11.394020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:05:11.394089 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:05:11.394153 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:05:11.394219 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:05:11.695818 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:05:12.778799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:05:12.778884 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:05:12.778951 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:05:12.779015 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:05:12.779080 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:05:12.779144 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:05:12.779209 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:05:13.091161 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:05:13.355153 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:05:13.355234 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:05:13.355303 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:05:13.355371 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:05:13.355434 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:05:13.355501 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:05:13.355565 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:05:13.660487 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:05:41.971488 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:05:41.971579 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:05:41.971643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:05:41.971710 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:05:41.971792 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:05:41.971864 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:05:41.971924 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:05:42.310125 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:05:43.357612 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:05:43.357695 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:05:43.357764 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:05:43.357828 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:05:43.357889 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:05:43.357951 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:05:43.358013 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:05:43.663519 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:06:12.569749 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:06:12.569841 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:06:12.569906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:06:12.569987 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:06:12.570053 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:06:12.570117 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:06:12.570182 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:06:12.885490 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:06:13.349510 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:06:13.349588 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:06:13.349652 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:06:13.349716 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:06:13.349786 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:06:13.349848 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:06:13.349909 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:06:13.652479 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:06:13.924226 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:06:13.924314 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:06:13.924384 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:06:13.924449 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:06:13.924512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:06:13.924575 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:06:13.924631 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:06:14.239306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:06:43.148180 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:06:43.148400 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:06:43.148568 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:06:43.148738 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:06:43.149133 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:06:43.149710 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:06:43.150015 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:06:43.453862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:06:44.501727 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:06:44.501846 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:06:44.501928 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:06:44.502013 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:06:44.502099 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:06:44.502188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:06:44.502266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:06:44.814073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:07:13.485317 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:07:13.485409 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:07:13.485479 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:07:13.485556 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:07:13.485633 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:07:13.485700 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:07:13.485778 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:07:13.797387 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:07:14.070099 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:07:14.070184 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:07:14.070244 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:07:14.070310 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:07:14.070379 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:07:14.070440 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:07:14.070505 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:07:14.382055 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:07:15.076191 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:07:15.076279 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:07:15.076356 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:07:15.076415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:07:15.076476 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:07:15.076537 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:07:15.076600 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:07:15.387072 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:07:44.070489 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:07:44.070571 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:07:44.070633 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:07:44.070698 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:07:44.070776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:07:44.070851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:07:44.070918 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:07:44.384835 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:07:45.644117 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:07:45.644254 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:07:45.644340 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:07:45.644413 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:07:45.644486 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:07:45.644546 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:07:45.644631 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:07:45.945443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:08:13.615162 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:08:13.615244 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:08:13.615311 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:08:13.615386 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:08:13.615451 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:08:13.615517 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:08:13.615583 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:08:13.935768 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:08:14.645222 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:08:14.645297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:08:14.645361 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:08:14.645420 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:08:14.645487 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:08:14.645546 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:08:14.645609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:08:14.951618 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:08:16.207753 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:08:16.207844 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:08:16.207910 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:08:16.207975 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:08:16.208036 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:08:16.208111 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:08:16.208177 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:08:16.509710 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:08:45.207339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:08:45.207424 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:08:45.207487 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:08:45.207555 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:08:45.207614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:08:45.207676 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:08:45.207741 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:08:45.514331 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:08:46.769514 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:08:46.769642 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:08:46.769711 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:08:46.769809 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:08:46.769881 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:08:46.769945 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:08:46.770013 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:08:47.075097 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:09:13.745666 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:09:13.745755 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:09:13.745820 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:09:13.745892 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:09:13.745953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:09:13.746013 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:09:13.746073 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:09:14.057931 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:09:15.780088 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:09:15.780196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:09:15.780258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:09:15.780322 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:09:15.780390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:09:15.780451 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:09:15.780519 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:09:16.093462 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:09:17.335834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:09:17.335919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:09:17.335983 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:09:17.336061 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:09:17.336125 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:09:17.336198 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:09:17.336258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:09:17.637621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:09:46.351214 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:09:46.351311 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:09:46.351376 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:09:46.351434 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:09:46.351498 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:09:46.351562 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:09:46.351621 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:09:46.653836 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:09:47.908815 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:09:47.908902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:09:47.908969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:09:47.909034 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:09:47.909101 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:09:47.909167 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:09:47.909224 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:09:48.220257 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:10:13.871521 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:10:13.871607 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:10:13.871685 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:10:13.872557 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:10:13.873096 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:10:13.873334 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:10:13.873523 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:10:14.176379 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:10:16.914029 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:10:16.914113 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:10:16.914184 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:10:16.914251 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:10:16.914318 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:10:16.914382 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:10:16.914450 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:10:17.218608 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:10:18.482969 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:10:18.483051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:10:18.483125 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:10:18.483189 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:10:18.483254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:10:18.483319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:10:18.483385 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:10:18.788700 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:10:47.481513 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:10:47.481617 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:10:47.481683 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:10:47.481749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:10:47.481816 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:10:47.481876 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:10:47.481938 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:10:47.790030 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:10:49.052612 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:10:49.052692 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:10:49.052766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:10:49.052836 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:10:49.052900 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:10:49.052960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:10:49.053024 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:10:49.364640 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:11:13.996317 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:11:13.996428 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:11:13.996511 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:11:13.996583 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:11:13.996660 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:11:13.996766 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:11:13.996851 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:11:14.313573 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:11:18.057726 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:11:18.057876 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:11:18.057964 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:11:18.058039 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:11:18.058142 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:11:18.058228 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:11:18.058322 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:11:18.362353 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:11:19.631943 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:11:19.632060 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:11:19.632169 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:11:19.632245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:11:19.632334 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:11:19.632417 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:11:19.632494 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:11:19.943976 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:11:48.620487 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:11:48.620589 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:11:48.620658 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:11:48.620731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:11:48.620796 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:11:48.620865 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:11:48.620930 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:11:48.935768 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:11:50.225151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:11:50.225242 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:11:50.225311 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:11:50.225374 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:11:50.225442 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:11:50.225512 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:11:50.225581 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:11:50.531164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:12:14.123412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:12:14.123493 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:12:14.123566 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:12:14.123625 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:12:14.123694 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:12:14.123763 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:12:14.123832 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:12:14.456169 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:12:19.201173 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:12:19.201256 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:12:19.201347 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:12:19.201409 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:12:19.201473 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:12:19.201539 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:12:19.201603 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:12:19.525221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:12:20.793888 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:12:20.793965 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:12:20.794041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:12:20.794106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:12:20.794180 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:12:20.794238 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:12:20.794302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:12:21.096651 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:12:49.789905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:12:49.790018 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:12:49.790106 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:12:49.790184 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:12:49.790268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:12:49.790346 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:12:49.790429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:12:50.101779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:12:51.356424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:12:51.356533 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:12:51.356607 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:12:51.356682 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:12:51.356759 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:12:51.356832 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:12:51.356906 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:12:51.662115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:13:14.258156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:13:14.258260 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:13:14.258343 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:13:14.258431 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:13:14.258508 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:13:14.258582 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:13:14.258675 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:13:14.560250 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:13:20.367626 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:13:20.367744 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:13:20.367812 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:13:20.367891 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:13:20.367954 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:13:20.368025 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:13:20.368100 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:13:20.671746 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:13:21.929187 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:13:21.929265 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:13:21.929332 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:13:21.929395 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:13:21.929459 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:13:21.929524 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:13:21.929584 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:13:22.261340 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:13:50.932826 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:13:50.932909 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:13:50.932983 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:13:50.933052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:13:50.933123 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:13:50.933187 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:13:50.933245 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:13:51.238812 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:13:52.526135 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:13:52.526250 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:13:52.526325 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:13:52.526408 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:13:52.526491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:13:52.526575 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:13:52.526650 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:13:52.825521 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:14:14.385058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:14:14.385163 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:14:14.385232 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:14:14.385312 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:14:14.385383 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:14:14.385476 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:14:14.385546 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:14:14.692260 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:14:21.502415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:14:21.502516 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:14:21.502595 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:14:21.502667 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:14:21.502778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:14:21.502864 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:14:21.502945 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:14:21.825253 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:14:23.088129 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:14:23.088217 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:14:23.088293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:14:23.088368 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:14:23.088445 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:14:23.088514 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:14:23.088587 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:14:23.394483 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:14:52.107028 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:14:52.107441 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:14:52.107556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:14:52.107637 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:14:52.107712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:14:52.107805 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:14:52.107871 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:14:52.422148 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:14:53.661367 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:14:53.661452 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:14:53.661528 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:14:53.661595 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:14:53.661661 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:14:53.661736 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:14:53.661800 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:14:53.968045 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:15:14.514165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:15:14.514260 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:15:14.514340 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:15:14.514423 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:15:14.514505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:15:14.514580 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:15:14.514657 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:15:14.822375 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:15:22.678473 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:15:22.678578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:15:22.678647 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:15:22.678727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:15:22.678799 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:15:22.678875 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:15:22.678939 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:15:22.984976 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:15:24.238865 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:15:24.238960 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:15:24.239026 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:15:24.239091 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:15:24.239159 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:15:24.239218 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:15:24.239281 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:15:24.554800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:15:53.241454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:15:53.241551 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:15:53.241612 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:15:53.241685 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:15:53.241764 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:15:53.241829 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:15:53.241899 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:15:53.553954 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:15:54.833871 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:15:54.834441 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:15:54.834964 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:15:54.835246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:15:54.836051 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:15:54.836174 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:15:54.836257 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:15:55.162635 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:16:14.644930 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:16:14.645016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:16:14.645082 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:16:14.645158 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:16:14.645229 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:16:14.645299 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:16:14.645366 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:16:14.959569 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:16:23.816743 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:16:23.816841 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:16:23.816924 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:16:23.817010 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:16:23.817073 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:16:23.817138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:16:23.817209 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:16:24.124786 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:16:25.427458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:16:25.427551 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:16:25.427637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:16:25.427728 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:16:25.427811 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:16:25.427886 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:16:25.427970 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:16:25.731104 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:16:54.405096 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:16:54.405211 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:16:54.405284 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:16:54.405353 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:16:54.405432 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:16:54.405508 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:16:54.405585 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:16:54.713948 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:16:55.988013 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:16:55.988103 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:16:55.988174 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:16:55.988237 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:16:55.988310 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:16:55.988376 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:16:55.988445 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:16:56.300480 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:17:14.772827 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:17:14.772917 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:17:14.772982 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:17:14.773050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:17:14.773119 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:17:14.773186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:17:14.773252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:17:15.080160 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:17:24.975965 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:17:24.976046 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:17:24.976118 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:17:24.976185 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:17:24.976256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:17:24.976325 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:17:24.976393 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:17:25.297132 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:17:26.561803 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:17:26.561899 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:17:26.561967 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:17:26.562031 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:17:26.562100 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:17:26.562164 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:17:26.562222 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:17:26.860317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:17:55.564610 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:17:55.564723 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:17:55.564793 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:17:55.564859 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:17:55.564925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:17:55.564984 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:17:55.565048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:17:55.873896 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:17:57.126649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:17:57.126742 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:17:57.126807 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:17:57.126869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:17:57.126929 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:17:57.126994 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:17:57.127056 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:17:57.433621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:18:14.908013 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:18:14.908094 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:18:14.908158 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:18:14.908218 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:18:14.908282 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:18:14.908343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:18:14.908409 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:18:15.219091 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:18:26.139924 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:18:26.140029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:18:26.140122 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:18:26.140193 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:18:26.140272 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:18:26.140356 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:18:26.140435 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:18:26.458135 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:18:27.696527 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:18:27.696627 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:18:27.696703 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:18:27.696800 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:18:27.696879 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:18:27.696974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:18:27.697045 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:18:28.004784 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:18:56.726458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:18:56.726578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:18:56.726659 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:18:56.726746 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:18:56.726836 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:18:56.726910 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:18:56.726988 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:18:57.034876 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:18:58.260211 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:18:58.260309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:18:58.260376 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:18:58.260455 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:18:58.260538 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:18:58.260607 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:18:58.260678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:18:58.565364 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:19:15.039014 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:19:15.039110 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:19:15.039184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:19:15.039283 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:19:15.039360 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:19:15.039438 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:19:15.039516 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:19:15.345185 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:19:27.298608 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:19:27.298698 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:19:27.298799 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:19:27.298873 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:19:27.298955 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:19:27.299033 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:19:27.299110 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:19:27.607746 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:19:28.829373 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:19:28.829477 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:19:28.829549 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:19:28.829626 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:19:28.829691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:19:28.829769 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:19:28.829839 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:19:29.135690 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:19:57.865530 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:19:57.865625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:19:57.865735 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:19:57.865812 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:19:57.865897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:19:57.865976 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:19:57.866058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:19:58.174709 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:19:59.400772 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:19:59.400882 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:19:59.400954 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:19:59.401023 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:19:59.401097 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:19:59.401170 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:19:59.401231 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:19:59.703678 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:20:15.168482 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:20:15.168577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:20:15.168647 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:20:15.168707 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:20:15.168792 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:20:15.168857 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:20:15.168928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:20:15.479521 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:20:28.438083 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:20:28.438179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:20:28.438243 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:20:28.438305 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:20:28.438371 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:20:28.438435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:20:28.439830 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:20:28.746321 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:20:29.968655 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:20:29.968763 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:20:29.968844 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:20:29.968927 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:20:29.969009 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:20:29.969087 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:20:29.969166 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:20:30.290679 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:20:59.023291 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:20:59.023428 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:20:59.023511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:20:59.023597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:20:59.023679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:20:59.023770 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:20:59.023858 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:20:59.339754 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:21:00.554714 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:21:00.554824 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:21:00.554922 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:21:00.555016 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:21:00.555096 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:21:00.555174 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:21:00.555248 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:21:00.865893 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:21:15.292917 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:21:15.293008 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:21:15.293079 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:21:15.293150 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:21:15.293228 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:21:15.293293 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:21:15.293365 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:21:15.594146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:21:29.601533 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:21:29.601619 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:21:29.601685 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:21:29.601758 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:21:29.601824 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:21:29.601898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:21:29.601955 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:21:29.907867 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:21:31.133061 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:21:31.133160 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:21:31.133238 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:21:31.133323 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:21:31.133393 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:21:31.133465 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:21:31.133558 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:21:31.434441 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:22:00.175169 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:22:00.175274 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:22:00.175349 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:22:00.175431 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:22:00.175501 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:22:00.175577 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:22:00.175647 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:22:00.482007 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:22:01.692314 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:22:01.692400 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:22:01.692473 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:22:01.692536 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:22:01.692602 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:22:01.692659 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:22:01.692727 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:22:02.007400 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:22:15.431422 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:22:15.431525 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:22:15.431602 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:22:15.431684 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:22:15.431775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:22:15.431858 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:22:15.431933 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:22:15.737193 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:22:30.741881 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:22:30.742003 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:22:30.742078 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:22:30.742150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:22:30.742225 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:22:30.742300 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:22:30.742379 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:22:31.043941 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:22:32.285613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:22:32.285694 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:22:32.285778 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:22:32.285848 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:22:32.285911 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:22:32.285972 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:22:32.286034 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:22:32.590209 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:23:01.302335 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:23:01.303253 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:23:01.303387 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:23:01.303477 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:23:01.303568 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:23:01.303663 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:23:01.303797 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:23:01.611097 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:23:02.846273 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:23:02.846363 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:23:02.846439 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:23:02.846509 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:23:02.846575 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:23:02.846649 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:23:02.846711 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:23:03.155440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:23:15.557059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:23:15.557151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:23:15.557231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:23:15.557311 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:23:15.557388 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:23:15.557464 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:23:15.557538 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:23:15.864058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:23:31.885091 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:23:31.885198 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:23:31.885277 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:23:31.885354 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:23:31.885440 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:23:31.885514 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:23:31.885586 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:23:32.216747 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:23:33.417530 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:23:33.417649 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:23:33.417724 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:23:33.417808 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:23:33.417881 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:23:33.417959 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:23:33.418031 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:23:33.725863 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:24:02.484417 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:24:02.484525 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:24:02.484604 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:24:02.484684 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:24:02.484778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:24:02.484851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:24:02.484930 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:24:02.789837 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:24:03.994298 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:24:03.994887 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:24:03.995191 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:24:03.995895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:24:03.996573 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:24:03.996691 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:24:03.996780 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:24:04.314982 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:24:15.679845 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:24:15.679938 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:24:15.680006 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:24:15.680080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:24:15.680150 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:24:15.680216 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:24:15.680280 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:24:15.992428 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:24:33.045469 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:24:33.045557 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:24:33.045623 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:24:33.045686 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:24:33.045784 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:24:33.045855 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:24:33.045928 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:24:33.359867 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:24:34.576236 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:24:34.576315 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:24:34.576386 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:24:34.576446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:24:34.576510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:24:34.576577 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:24:34.576636 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:24:34.887851 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:25:03.621511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:25:03.621604 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:25:03.621695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:25:03.622377 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:25:03.622549 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:25:03.622670 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:25:03.622803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:25:03.930204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:25:05.148658 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:25:05.148787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:25:05.148872 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:25:05.148974 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:25:05.149064 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:25:05.149168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:25:05.149252 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:25:05.456133 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:25:15.805253 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:25:15.805346 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:25:15.805446 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:25:15.805522 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:25:15.805597 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:25:15.805674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:25:15.805740 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:25:16.118183 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:25:34.186856 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:25:34.186949 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:25:34.187042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:25:34.187120 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:25:34.187195 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:25:34.187266 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:25:34.187334 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:25:34.497828 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:25:35.715435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:25:35.715522 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:25:35.715613 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:25:35.715691 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:25:35.715767 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:25:35.715835 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:25:35.715921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:25:36.013365 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:26:04.758142 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:26:04.758248 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:26:04.758324 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:26:04.758412 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:26:04.758493 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:26:04.758588 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:26:04.758670 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:26:05.076410 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:26:06.278188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:26:06.278303 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:26:06.278388 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:26:06.278458 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:26:06.278528 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:26:06.278615 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:26:06.278679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:26:06.579564 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:26:15.922768 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:26:15.922878 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:26:15.922960 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:26:15.923036 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:26:15.923119 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:26:15.923187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:26:15.923263 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:26:16.226004 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:26:35.340666 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:26:35.340797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:26:35.340883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:26:35.340969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:26:35.341046 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:26:35.341127 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:26:35.341210 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:26:35.642663 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:26:36.843741 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:26:36.843836 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:26:36.843912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:26:36.843990 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:26:36.844062 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:26:36.844130 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:26:36.844201 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:26:37.148324 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:27:05.909373 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:27:05.909472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:27:05.909552 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:27:05.909636 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:27:05.909730 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:27:05.909812 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:27:05.909893 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:27:06.211846 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:27:07.411748 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:27:07.411864 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:27:07.411951 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:27:07.412032 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:27:07.412129 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:27:07.412202 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:27:07.412280 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:27:07.709323 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:27:16.045990 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:27:16.046097 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:27:16.046169 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:27:16.046251 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:27:16.046329 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:27:16.046404 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:27:16.046482 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:27:16.345287 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:27:36.475933 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:27:36.476020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:27:36.476091 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:27:36.476160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:27:36.476230 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:27:36.476298 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:27:36.476364 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:27:36.779355 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:27:37.973626 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:27:37.973705 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:27:37.973783 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:27:37.973844 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:27:37.973923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:27:37.974003 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:27:37.974070 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:27:38.273866 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:28:07.041534 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:28:07.041641 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:28:07.041730 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:28:07.041796 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:28:07.041861 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:28:07.041927 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:28:07.042001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:28:07.346788 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:28:08.540451 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:28:08.540540 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:28:08.540605 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:28:08.540668 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:28:08.540742 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:28:08.540803 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:28:08.540866 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:28:08.842127 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:28:16.169427 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:28:16.169504 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:28:16.169571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:28:16.169630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:28:16.169695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:28:16.169767 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:28:16.169829 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:28:16.474166 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:28:37.609853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:28:37.610628 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:28:37.610776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:28:37.610863 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:28:37.610964 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:28:37.611074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:28:37.611166 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:28:37.916748 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:28:39.102420 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:28:39.102528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:28:39.102599 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:28:39.102668 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:28:39.102741 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:28:39.102810 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:28:39.102878 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:28:39.410971 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:29:08.181808 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:29:08.181895 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:29:08.181967 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:29:08.182034 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:29:08.182103 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:29:08.182171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:29:08.182238 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:29:08.488557 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:29:09.676397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:29:09.676508 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:29:09.676590 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:29:09.676660 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:29:09.676763 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:29:09.676843 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:29:09.676922 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:29:09.987108 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:29:16.294697 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:29:16.294789 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:29:16.294855 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:29:16.294918 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:29:16.294986 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:29:16.295055 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:29:16.295114 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:29:16.601200 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:29:38.746979 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:29:38.747077 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:29:38.747138 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:29:38.747201 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:29:38.747266 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:29:38.747330 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:29:38.747401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:29:39.052145 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:29:40.259846 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:29:40.259965 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:29:40.260055 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:29:40.260146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:29:40.260239 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:29:40.261366 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:29:40.261898 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:29:40.569833 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:30:09.313822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:30:09.313906 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:30:09.313990 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:30:09.314059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:30:09.314127 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:30:09.314199 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:30:09.314275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:30:09.616460 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:30:10.836630 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:30:10.836748 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:30:10.836812 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:30:10.836878 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:30:10.836942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:30:10.837008 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:30:10.837071 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:30:11.142116 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:30:16.416414 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:30:16.416498 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:30:16.416566 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:30:16.416630 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:30:16.416695 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:30:16.416769 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:30:16.416841 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:30:16.725151 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:30:39.878128 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:30:39.878217 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:30:39.878278 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:30:39.878342 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:30:39.878409 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:30:39.878476 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:30:39.878538 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:30:40.196115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:30:41.403993 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:30:41.404108 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:30:41.404168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:30:41.404231 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:30:41.404289 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:30:41.404360 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:30:41.404425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:30:41.710937 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:31:10.463915 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:31:10.464016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:31:10.464108 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:31:10.464186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:31:10.464276 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:31:10.464361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:31:10.464446 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:31:10.763374 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:31:11.997997 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:31:11.998091 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:31:11.998175 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:31:11.998255 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:31:11.998339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:31:11.998417 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:31:11.998508 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:31:12.326265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:31:16.538231 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:31:16.538322 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:31:16.538393 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:31:16.538469 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:31:16.538549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:31:16.538624 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:31:16.538699 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:31:16.847232 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:31:41.027076 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:31:41.027181 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:31:41.027259 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:31:41.027337 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:31:41.027422 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:31:41.027503 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:31:41.027580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:31:41.329129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:31:42.587139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:31:42.587250 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:31:42.587336 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:31:42.587412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:31:42.587499 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:31:42.587583 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:31:42.587664 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:31:42.899093 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:32:11.597018 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:32:11.597121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:32:11.597205 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:32:11.597288 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:32:11.597357 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:32:11.597436 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:32:11.597511 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:32:11.904895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:32:13.165048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:32:13.165852 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:32:13.166738 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:32:13.166854 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:32:13.166938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:32:13.167012 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:32:13.167086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:32:13.477801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:32:16.663667 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:32:16.663762 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:32:16.663837 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:32:16.663900 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:32:16.663972 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:32:16.664039 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:32:16.664111 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:32:16.972612 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:32:42.171426 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:32:42.171513 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:32:42.171578 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:32:42.171647 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:32:42.171713 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:32:42.171785 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:32:42.171847 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:32:42.483953 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:32:43.743320 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:32:43.743401 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:32:43.743467 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:32:43.743536 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:32:43.743597 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:32:43.743660 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:32:43.743730 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:32:44.061408 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:33:12.751219 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:33:12.751304 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:33:12.751388 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:33:12.751453 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:33:12.751518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:33:12.751580 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:33:12.751645 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:33:13.054471 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:33:14.324246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:33:14.324331 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:33:14.324421 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:33:14.324480 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:33:14.324549 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:33:14.324611 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:33:14.324674 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:33:14.631784 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:33:16.793547 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:33:16.793712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:33:16.794209 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:33:16.794878 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:33:16.795636 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:33:16.795758 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:33:16.795835 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:33:17.108473 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:33:43.313834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:33:43.313950 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:33:43.314038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:33:43.314119 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:33:43.314198 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:33:43.314278 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:33:43.314360 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:33:43.624803 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:33:44.888489 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:33:44.888575 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:33:44.888643 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:33:44.888735 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:33:44.888805 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:33:44.888888 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:33:44.888956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:33:45.196499 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:34:13.891313 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:34:13.891408 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:34:13.891486 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:34:13.891567 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:34:13.891653 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:34:13.891740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:34:13.891818 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:34:14.202992 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:34:15.454997 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:34:15.455094 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:34:15.455194 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:34:15.455270 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:34:15.455361 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:34:15.455434 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:34:15.455504 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:34:15.757058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:34:16.915650 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:34:16.915771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:34:16.915860 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:34:16.915939 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:34:16.916017 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:34:16.916090 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:34:16.916166 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:34:17.223528 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:34:44.457910 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:34:44.458033 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:34:44.458116 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:34:44.458208 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:34:44.458290 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:34:44.458375 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:34:44.458457 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:34:44.775645 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:34:46.018941 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:34:46.019048 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:34:46.019126 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:34:46.019210 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:34:46.019285 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:34:46.019360 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:34:46.019435 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:34:46.321167 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:35:15.045329 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:35:15.045427 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:35:15.045492 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:35:15.045558 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:35:15.045635 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:35:15.045710 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:35:15.045779 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:35:15.354983 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:35:16.579941 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:35:16.580031 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:35:16.580089 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:35:16.580154 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:35:16.580222 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:35:16.580288 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:35:16.580348 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:35:16.898486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:35:17.164129 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:35:17.164228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:35:17.164302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:35:17.164367 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:35:17.164438 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:35:17.164506 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:35:17.164564 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:35:17.468222 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:35:45.612287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:35:45.612374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:35:45.612444 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:35:45.612516 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:35:45.612580 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:35:45.612644 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:35:45.612705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:35:45.916220 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:35:47.164777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:35:47.164867 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:35:47.164937 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:35:47.164998 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:35:47.165063 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:35:47.165130 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:35:47.165190 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:35:47.472117 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:36:16.177350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:36:16.177434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:36:16.177508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:36:16.177571 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:36:16.177648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:36:16.177711 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:36:16.177777 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:36:16.480081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:36:17.158682 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:36:17.158770 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:36:17.158839 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:36:17.158900 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:36:17.158977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:36:17.159053 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:36:17.159118 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:36:17.461891 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:36:17.744780 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:36:17.744875 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:36:17.744945 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:36:17.745013 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:36:17.745076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:36:17.745156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:36:17.745230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:36:18.051538 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:36:46.734662 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:36:46.734766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:36:46.734843 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:36:46.734904 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:36:46.734968 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:36:46.735030 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:36:46.735090 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:36:47.046157 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:36:48.313603 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:36:48.313705 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:36:48.313770 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:36:48.313840 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:36:48.313901 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:36:48.313964 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:36:48.314027 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:36:48.615034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:37:17.283743 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:37:17.283860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:37:17.283945 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:37:17.284017 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:37:17.284086 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:37:17.284156 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:37:17.284224 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:37:17.590024 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:37:17.865469 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:37:17.865590 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:37:17.865668 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:37:17.865753 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:37:17.865830 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:37:17.865921 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:37:17.866005 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:37:18.166989 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:37:18.880139 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:37:18.880251 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:37:18.880317 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:37:18.880386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:37:18.880459 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:37:18.880535 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:37:18.880609 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:37:19.186360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:37:47.866586 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:37:47.866671 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:37:47.866759 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:37:47.866824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:37:47.866894 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:37:47.866954 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:37:47.867020 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:37:48.174946 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:37:49.448673 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:37:49.449707 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:37:49.450159 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:37:49.450839 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:37:49.451045 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:37:49.451242 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:37:49.452205 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:37:49.757942 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:38:17.412483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:38:17.412567 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:38:17.412651 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:38:17.412723 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:38:17.412785 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:38:17.412857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:38:17.412926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:38:17.723952 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:38:18.438524 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:38:18.438624 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:38:18.438687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:38:18.438764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:38:18.438827 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:38:18.438888 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:38:18.438953 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:38:18.746219 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:38:20.033465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:38:20.033550 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:38:20.033618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:38:20.033687 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:38:20.033758 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:38:20.033826 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:38:20.033907 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:38:20.350349 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:38:49.007679 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:38:49.007772 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:38:49.007833 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:38:49.007901 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:38:49.007960 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:38:49.008023 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:38:49.008086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:38:49.318101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:38:50.615674 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:38:50.615778 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:38:50.615843 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:38:50.615912 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:38:50.615972 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:38:50.616044 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:38:50.616103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:38:50.920141 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:39:17.544246 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:39:17.544353 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:39:17.544427 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:39:17.544503 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:39:17.544567 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:39:17.544646 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:39:17.544713 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:39:17.870700 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:39:19.585351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:39:19.585455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:39:19.585549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:39:19.585627 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:39:19.585706 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:39:19.585810 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:39:19.585891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:39:19.900679 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:39:21.183355 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:39:21.183447 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:39:21.183530 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:39:21.183609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:39:21.183689 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:39:21.183772 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:39:21.183850 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:39:21.487668 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:39:50.165839 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:39:50.165940 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:39:50.166016 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:39:50.166100 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:39:50.166178 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:39:50.166263 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:39:50.166352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:39:50.473083 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:39:51.747292 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:39:51.747394 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:39:51.747465 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:39:51.747542 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:39:51.747617 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:39:51.747689 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:39:51.747765 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:39:52.068119 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:40:17.662161 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:40:17.662254 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:40:17.662317 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:40:17.662383 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:40:17.662446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:40:17.662507 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:40:17.662579 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:40:17.975687 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:40:20.736241 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:40:20.736335 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:40:20.736400 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:40:20.736470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:40:20.736536 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:40:20.736607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:40:20.736673 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:40:21.046103 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:40:22.336729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:40:22.336834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:40:22.336913 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:40:22.336996 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:40:22.337065 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:40:22.337140 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:40:22.337212 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:40:22.640184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:40:51.308831 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:40:51.308916 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:40:51.308992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:40:51.309065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:40:51.309139 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:40:51.309212 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:40:51.309286 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:40:51.613767 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:40:52.902040 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:40:52.902143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:40:52.902232 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:40:52.902302 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:40:52.902374 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:40:52.902433 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:40:52.902497 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:40:53.211724 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:41:17.784119 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:41:17.784213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:41:17.784294 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:41:17.784387 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:41:17.784466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:41:17.784547 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:41:17.784638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:41:18.089971 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:41:21.874052 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:41:21.874177 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:41:21.874257 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:41:21.874336 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:41:21.874408 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:41:21.874481 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:41:21.875627 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:41:22.191785 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:41:23.474047 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:41:23.474147 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:41:23.474221 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:41:23.474289 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:41:23.474358 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:41:23.474430 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:41:23.474500 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:41:23.782377 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:41:52.456271 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:41:52.456378 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:41:52.456449 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:41:52.456513 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:41:52.456575 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:41:52.456642 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:41:52.456708 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:41:52.762382 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:41:54.048133 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:41:54.048220 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:41:54.048282 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:41:54.048352 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:41:54.048412 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:41:54.048472 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:41:54.048539 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:41:54.355714 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:42:17.906019 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:42:17.906103 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:42:17.906167 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:42:17.906231 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:42:17.906293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:42:17.906359 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:42:17.906421 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:42:18.210118 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:42:23.026394 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:42:23.026511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:42:23.026585 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:42:23.026691 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:42:23.026774 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:42:23.026864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:42:23.026934 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:42:23.335112 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:42:24.626201 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:42:24.626335 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:42:24.626430 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:42:24.626520 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:42:24.626598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:42:24.626691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:42:24.626780 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:42:24.931541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:42:53.596865 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:42:53.596981 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:42:53.597063 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:42:53.597132 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:42:53.597199 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:42:53.597262 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:42:53.597336 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:42:53.909515 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:42:55.193697 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:42:55.193788 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:42:55.193864 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:42:55.193931 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:42:55.193994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:42:55.194052 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:42:55.194116 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:42:55.496473 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:43:18.027206 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:43:18.027282 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:43:18.027350 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:43:18.027410 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:43:18.027479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:43:18.027548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:43:18.027610 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:43:18.335917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:43:24.172492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:43:24.172572 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:43:24.172634 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:43:24.172725 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:43:24.172786 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:43:24.172852 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:43:24.172911 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:43:24.477875 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:43:25.759444 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:43:25.759532 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:43:25.759595 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:43:25.759659 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:43:25.759722 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:43:25.759786 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:43:25.759849 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:43:26.069055 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:43:54.741130 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:43:54.741258 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:43:54.741337 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:43:54.741408 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:43:54.741488 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:43:54.741557 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:43:54.741624 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:43:55.047317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:43:56.331476 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:43:56.331588 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:43:56.331647 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:43:56.331708 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:43:56.331780 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:43:56.331844 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:43:56.331909 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:43:56.640484 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:44:18.153034 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:44:18.153119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:44:18.153192 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:44:18.153254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:44:18.153315 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:44:18.153377 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:44:18.153435 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:44:18.464648 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:44:25.311546 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:44:25.311651 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:44:25.311733 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:44:25.311820 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:44:25.311896 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:44:25.311974 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:44:25.312054 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:44:25.621042 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:44:26.914240 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:44:26.914359 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:44:26.914441 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:44:26.914531 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:44:26.914602 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:44:26.914679 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:44:26.914756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:44:27.218533 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:44:55.882923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:44:55.883092 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:44:55.883178 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:44:55.883263 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:44:55.883344 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:44:55.883455 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:44:55.883545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:44:56.183416 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:44:57.478058 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:44:57.478147 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:44:57.478219 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:44:57.478283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:44:57.478365 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:44:57.478435 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:44:57.478510 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:44:57.781616 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:45:18.278585 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:45:18.278668 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:45:18.278743 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:45:18.278810 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:45:18.278879 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:45:18.278942 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:45:18.279008 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:45:18.584988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:45:26.442578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:45:26.442689 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:45:26.442761 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:45:26.442829 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:45:26.442896 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:45:26.442954 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:45:26.443021 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:45:26.747753 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:45:28.041597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:45:28.041694 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:45:28.041805 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:45:28.041888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:45:28.041967 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:45:28.042038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:45:28.042116 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:45:28.342759 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:45:57.016296 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:45:57.016410 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:45:57.016491 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:45:57.016560 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:45:57.016630 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:45:57.016697 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:45:57.016775 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:45:57.325737 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:45:58.607999 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:45:58.608122 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:45:58.608189 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:45:58.608261 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:45:58.608332 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:45:58.608406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:45:58.608472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:45:58.915541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:46:18.406919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:46:18.406998 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:46:18.407065 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:46:18.407131 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:46:18.407200 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:46:18.407261 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:46:18.407326 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:46:18.714233 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:46:27.587025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:46:27.587107 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:46:27.587163 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:46:27.587229 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:46:27.587293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:46:27.587359 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:46:27.587418 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:46:27.894150 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:46:29.187159 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:46:29.187255 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:46:29.187317 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:46:29.187380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:46:29.187445 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:46:29.187511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:46:29.187572 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:46:29.496676 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:46:58.155664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:46:58.155761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:46:58.155828 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:46:58.155898 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:46:58.155974 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:46:58.156050 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:46:58.156115 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:46:58.461212 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:46:59.756338 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:46:59.756429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:46:59.756497 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:46:59.756563 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:46:59.756621 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:46:59.756684 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:46:59.756753 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:47:00.082435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:47:18.530025 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:47:18.530119 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:47:18.530197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:47:18.530264 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:47:18.530346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:47:18.530468 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:47:18.530536 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:47:18.837104 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:47:28.729192 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:47:28.729314 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:47:28.729402 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:47:28.729466 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:47:28.729527 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:47:28.729596 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:47:28.729660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:47:29.041850 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:47:30.359732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:47:30.359847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:47:30.359912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:47:30.359978 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:47:30.360043 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:47:30.360106 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:47:30.360171 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:47:30.663860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:47:59.310811 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:47:59.310899 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:47:59.310974 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:47:59.311041 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:47:59.311105 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:47:59.311168 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:47:59.311232 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:47:59.617175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:48:00.927281 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:48:00.927382 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:48:00.927445 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:48:00.927512 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:48:00.927576 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:48:00.927642 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:48:00.927709 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:48:01.232552 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:48:18.646754 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:48:18.646835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:48:18.646898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:48:18.646983 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:48:18.647046 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:48:18.647105 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:48:18.647161 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:48:18.953356 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:48:29.880269 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:48:29.880355 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:48:29.880438 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:48:29.880511 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:48:29.880584 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:48:29.880654 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:48:29.880731 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:48:30.193913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:48:31.495820 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:48:31.495915 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:48:31.495992 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:48:31.496075 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:48:31.496150 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:48:31.496213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:48:31.496279 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:48:31.816565 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:49:00.455680 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:49:00.455787 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:49:00.455854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:49:00.455919 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:49:00.455979 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:49:00.456049 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:49:00.456114 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:49:00.752522 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:49:02.089471 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:49:02.089572 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:49:02.089644 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:49:02.089715 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:49:02.089814 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:49:02.089887 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:49:02.089954 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:49:02.416522 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:49:18.769901 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:49:18.769978 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:49:18.770041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:49:18.770111 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:49:18.770175 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:49:18.770241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:49:18.770302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:49:19.074002 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:49:31.018067 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:49:31.018197 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:49:31.018289 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:49:31.018378 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:49:31.018460 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:49:31.018573 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:49:31.018666 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:49:31.327940 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:49:32.683909 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:49:32.684046 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:49:32.684128 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:49:32.684212 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:49:32.684288 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:49:32.684370 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:49:32.684465 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:49:32.995078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:50:01.586504 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:50:01.586604 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:50:01.586671 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:50:01.586753 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:50:01.586819 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:50:01.586889 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:50:01.586961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:50:01.910864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:50:03.261278 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:50:03.261387 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:50:03.261492 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:50:03.261578 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:50:03.261674 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:50:03.261784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:50:03.261871 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:50:03.567125 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:50:18.897039 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:50:18.897135 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:50:18.897213 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:50:18.897304 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:50:18.897387 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:50:18.897469 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:50:18.897549 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:50:19.212313 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:50:32.173589 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:50:32.173707 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:50:32.173814 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:50:32.173907 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:50:32.174007 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:50:32.174104 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:50:32.174187 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:50:32.480824 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:50:33.823330 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:50:33.823430 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:50:33.823517 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:50:33.823626 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:50:33.823704 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:50:33.823802 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:50:33.823889 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:50:34.128241 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:51:02.740481 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:51:02.740576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:51:02.740662 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:51:02.740724 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:51:02.740787 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:51:02.740849 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:51:02.740917 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:51:03.044406 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:51:04.399601 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:51:04.399691 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:51:04.399780 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:51:04.399851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:51:04.399910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:51:04.399991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:51:04.400053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:51:04.701341 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:51:19.016219 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:51:19.016306 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:51:19.016371 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:51:19.016434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:51:19.016491 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:51:19.016556 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:51:19.016618 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:51:19.324757 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:51:33.308174 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:51:33.308274 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:51:33.308346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:51:33.308409 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:51:33.308472 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:51:33.308540 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:51:33.308601 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:51:33.619631 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:51:34.967496 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:51:34.967592 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:51:34.967653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:51:34.967738 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:51:34.967808 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:51:34.967880 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:51:34.967949 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:51:35.272383 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:52:03.890155 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:52:03.890237 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:52:03.890312 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:52:03.890382 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:52:03.890452 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:52:03.890520 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:52:03.890591 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:52:04.213880 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:52:05.540590 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:52:05.540673 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:52:05.540771 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:52:05.540835 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:52:05.540895 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:52:05.540952 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:52:05.541015 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:52:05.844264 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:52:19.149236 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:52:19.149324 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:52:19.149397 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:52:19.149460 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:52:19.149523 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:52:19.149587 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:52:19.149656 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:52:19.454456 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:52:34.477947 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:52:34.478052 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:52:34.478116 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:52:34.478175 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:52:34.478238 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:52:34.478294 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:52:34.478364 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:52:34.782706 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:52:36.111171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:52:36.111255 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:52:36.111330 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:52:36.111402 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:52:36.111464 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:52:36.111519 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:52:36.111578 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:52:36.413715 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:53:05.055220 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:53:05.055298 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:53:05.055380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:53:05.055442 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:53:05.056320 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:53:05.056560 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:53:05.056697 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:53:05.368116 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:53:06.669563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:53:06.669655 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:53:06.669727 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:53:06.669803 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:53:06.669874 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:53:06.669941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:53:06.670009 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:53:06.975140 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:53:19.273329 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:53:19.273406 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:53:19.273473 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:53:19.273543 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:53:19.273612 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:53:19.273678 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:53:19.273753 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:53:19.585813 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:53:35.631847 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:53:35.631931 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:53:35.631999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:53:35.632065 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:53:35.632125 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:53:35.632184 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:53:35.632248 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:53:35.938757 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:53:37.235821 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:53:37.235904 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:53:37.235972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:53:37.236048 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:53:37.236113 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:53:37.236172 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:53:37.236236 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:53:37.539130 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:54:06.198769 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:54:06.198848 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:54:06.198910 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:54:06.198984 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:54:06.199049 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:54:06.199115 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:54:06.199178 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:54:06.499956 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:54:07.798875 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:54:07.798982 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:54:07.799090 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:54:07.799198 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:54:07.799277 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:54:07.799369 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:54:07.799456 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:54:08.108851 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:54:19.398901 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:54:19.398983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:54:19.399057 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:54:19.399122 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:54:19.399191 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:54:19.399255 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:54:19.399312 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:54:19.703673 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:54:36.764096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:54:36.764197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:54:36.764260 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:54:36.764323 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:54:36.764394 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:54:36.764461 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:54:36.764519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:54:37.078814 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:54:38.369557 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:54:38.369675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:54:38.369773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:54:38.369884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:54:38.369958 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:54:38.370042 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:54:38.370126 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:54:38.676792 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:55:07.348598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:55:07.348703 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:55:07.348767 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:55:07.348849 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:55:07.348918 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:55:07.348991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:55:07.349064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:55:07.655397 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:55:08.940174 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:55:08.940275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:55:08.940342 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:55:08.940411 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:55:08.940478 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:55:08.940537 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:55:08.940602 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:55:09.243086 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:55:19.517760 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:55:19.517837 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:55:19.517909 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:55:19.517978 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:55:19.518041 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:55:19.518100 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:55:19.518159 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:55:19.830401 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:55:37.920966 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:55:37.921065 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:55:37.921132 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:55:37.921204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:55:37.921265 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:55:37.921332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:55:37.921398 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:55:38.226233 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:55:39.505508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:55:39.505599 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:55:39.505664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:55:39.505737 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:55:39.505802 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:55:39.505872 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:55:39.505932 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:55:39.813663 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:56:08.486478 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:56:08.486559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:56:08.486629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:56:08.486694 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:56:08.486765 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:56:08.486824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:56:08.486886 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:56:08.794468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:56:10.096733 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:56:10.096819 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:56:10.096889 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:56:10.096963 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:56:10.097027 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:56:10.097092 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:56:10.097152 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:56:10.401630 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:56:19.639772 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:56:19.639853 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:56:19.639923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:56:19.639991 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:56:19.640058 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:56:19.640128 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:56:19.640206 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:56:19.961235 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:56:39.057246 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:56:39.057364 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:56:39.057429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:56:39.057494 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:56:39.057556 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:56:39.057625 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:56:39.057688 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:56:39.364868 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:56:40.661248 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:56:40.661328 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:56:40.661397 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:56:40.661454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:56:40.661521 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:56:40.661583 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:56:40.661655 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:56:40.965485 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:57:09.627347 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:57:09.627437 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:57:09.627515 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:57:09.627577 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:57:09.627637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:57:09.627704 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:57:09.627778 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:57:09.939435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:57:11.226652 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:57:11.226762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:57:11.226836 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:57:11.226895 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:57:11.226960 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:57:11.227018 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:57:11.227085 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:57:11.534249 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:57:19.761968 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:57:19.762061 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:57:19.762140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:57:19.762210 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:57:19.762281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:57:19.762375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:57:19.762455 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:57:20.083869 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:57:40.202621 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:57:40.202751 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:57:40.202818 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:57:40.202885 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:57:40.202950 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:57:40.203011 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:57:40.203076 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:57:40.512029 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:57:41.808649 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:57:41.808746 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:57:41.808828 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:57:41.808895 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:57:41.808982 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:57:41.809048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:57:41.809117 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:57:42.129737 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:58:10.775909 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:58:10.776009 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:58:10.776092 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:58:10.776173 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:58:10.776249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:58:10.776325 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:58:10.776402 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:58:11.083663 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:58:12.393709 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:58:12.393823 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:58:12.393901 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:58:12.393977 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:58:12.394050 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:58:12.394124 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:58:12.394197 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:58:12.700265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:58:19.886581 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:58:19.886673 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:58:19.886764 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:58:19.886832 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:58:19.886908 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:58:19.886979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:58:19.887059 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:58:20.212313 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:58:41.344904 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:58:41.345015 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:58:41.345085 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:58:41.345162 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:58:41.345230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:58:41.345297 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:58:41.345365 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:58:41.648731 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:58:42.964048 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:58:42.964155 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:58:42.964243 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:58:42.964329 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:58:42.964407 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:58:42.964473 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:58:42.964546 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:58:43.270261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:59:11.917733 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:59:11.917844 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:59:11.917936 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:59:11.918038 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:59:11.918104 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:59:11.918177 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:59:11.918251 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:59:12.245347 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:59:13.531179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:59:13.531267 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:59:13.531335 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:59:13.531399 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:59:13.531469 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:59:13.531540 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:59:13.531604 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:59:13.838249 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:59:20.013677 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:59:20.013803 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:59:20.013889 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:59:20.013957 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:59:20.014028 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:59:20.014102 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:59:20.014165 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:59:20.331809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:59:42.514512 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:59:42.514603 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:59:42.514672 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:59:42.514757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:59:42.514824 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:59:42.514886 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:59:42.514959 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:59:42.827941 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 04:59:44.107312 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 04:59:44.107454 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 04:59:44.107553 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 04:59:44.107637 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 04:59:44.107725 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 04:59:44.107821 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 04:59:44.107934 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 04:59:44.410383 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:00:13.084189 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:00:13.084282 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:00:13.084352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:00:13.084427 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:00:13.084496 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:00:13.084566 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:00:13.084633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:00:13.396857 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:00:14.674017 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:00:14.674117 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:00:14.674190 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:00:14.674256 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:00:14.674326 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:00:14.674387 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:00:14.674449 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:00:14.977962 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:00:20.131510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:00:20.131592 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:00:20.131665 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:00:20.131731 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:00:20.131794 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:00:20.131857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:00:20.131922 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:00:20.444503 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:00:43.663942 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:00:43.664026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:00:43.664088 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:00:43.664149 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:00:43.664209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:00:43.664269 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:00:43.664326 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:00:43.980427 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:00:45.244210 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:00:45.244327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:00:45.244386 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:00:45.244454 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:00:45.244511 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:00:45.244571 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:00:45.244635 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:00:45.554275 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:01:14.243474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:01:14.243569 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:01:14.243639 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:01:14.243701 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:01:14.243770 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:01:14.243840 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:01:14.243908 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:01:14.555512 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:01:15.810934 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:01:15.811015 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:01:15.811104 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:01:15.811166 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:01:15.811228 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:01:15.811286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:01:15.811354 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:01:16.119951 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:01:20.262834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:01:20.262910 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:01:20.262982 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:01:20.263044 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:01:20.263110 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:01:20.263177 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:01:20.263238 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:01:20.572801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:01:44.819485 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:01:44.819577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:01:44.819638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:01:44.819711 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:01:44.819801 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:01:44.819860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:01:44.819921 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:01:45.126984 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:01:46.378879 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:01:46.378956 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:01:46.379030 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:01:46.379099 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:01:46.379167 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:01:46.379233 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:01:46.379295 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:01:46.682742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:02:15.385517 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:02:15.385598 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:02:15.385679 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:02:15.385755 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:02:15.385820 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:02:15.385900 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:02:15.385968 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:02:15.695619 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:02:16.943006 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:02:16.943084 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:02:16.943155 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:02:16.943224 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:02:16.943289 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:02:16.943345 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:02:16.943414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:02:17.248186 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:02:20.389370 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:02:20.389452 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:02:20.389527 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:02:20.389595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:02:20.389662 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:02:20.389728 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:02:20.389800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:02:20.699196 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:02:45.961602 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:02:45.961684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:02:45.961759 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:02:45.961827 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:02:45.961902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:02:45.961967 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:02:45.962030 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:02:46.267688 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:02:47.506077 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:02:47.506160 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:02:47.506222 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:02:47.506288 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:02:47.506351 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:02:47.506420 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:02:47.506478 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:02:47.820343 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:03:16.530376 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:03:16.530469 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:03:16.530544 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:03:16.530613 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:03:16.530700 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:03:16.530793 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:03:16.530856 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:03:16.836331 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:03:18.083633 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:03:18.083736 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:03:18.083823 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:03:18.083889 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:03:18.083950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:03:18.084010 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:03:18.084070 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:03:18.389391 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:03:20.512963 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:03:20.513041 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:03:20.513111 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:03:20.513176 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:03:20.513238 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:03:20.513297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:03:20.513361 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:03:20.820626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:03:47.106516 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:03:47.106613 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:03:47.106676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:03:47.106740 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:03:47.106801 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:03:47.106865 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:03:47.106925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:03:47.416859 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:03:48.649068 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:03:48.649158 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:03:48.649228 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:03:48.649290 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:03:48.649354 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:03:48.649416 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:03:48.649478 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:03:48.962485 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:04:17.683508 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:04:17.683592 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:04:17.683666 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:04:17.683748 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:04:17.683812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:04:17.683864 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:04:17.683930 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:04:17.990306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:04:19.234594 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:04:19.234798 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:04:19.234912 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:04:19.235003 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:04:19.235082 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:04:19.235166 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:04:19.235252 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:04:19.543621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:04:20.637603 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:04:20.637699 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:04:20.637812 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:04:20.637899 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:04:20.637979 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:04:20.638066 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:04:20.638149 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:04:20.951683 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:04:48.253018 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:04:48.253128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:04:48.253214 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:04:48.253291 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:04:48.253364 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:04:48.253444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:04:48.253520 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:04:48.565447 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:04:49.801166 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:04:49.801253 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:04:49.801348 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:04:49.801422 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:04:49.801504 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:04:49.801580 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:04:49.801654 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:04:50.116892 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:05:18.831994 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:05:18.832131 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:05:18.832229 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:05:18.832328 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:05:18.832435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:05:18.832532 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:05:18.832645 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:05:19.132776 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:05:20.383366 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:05:20.383482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:05:20.383571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:05:20.383648 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:05:20.383748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:05:20.383834 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:05:20.383923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:05:20.694019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:05:20.960130 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:05:20.960226 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:05:20.960303 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:05:20.960371 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:05:20.960449 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:05:20.960525 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:05:20.960601 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:05:21.266826 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:05:49.394623 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:05:49.394709 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:05:49.394793 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:05:49.394859 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:05:49.394928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:05:49.394999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:05:49.395077 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:05:49.699832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:05:50.958475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:05:50.958571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:05:50.958636 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:05:50.958708 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:05:50.958780 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:05:50.958846 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:05:50.958923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:05:51.268011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:06:19.973128 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:06:19.973228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:06:19.973307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:06:19.973382 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:06:19.973473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:06:19.973541 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:06:19.973618 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:06:20.298910 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:06:20.872388 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:06:20.872486 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:06:20.872570 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:06:20.872648 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:06:20.872738 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:06:20.872822 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:06:20.872901 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:06:21.181401 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:06:21.531139 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:06:21.531229 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:06:21.531302 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:06:21.531365 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:06:21.531427 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:06:21.531492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:06:21.531558 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:06:21.837761 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:06:50.559625 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:06:50.559733 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:06:50.559805 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:06:50.559873 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:06:50.559938 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:06:50.560003 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:06:50.560066 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:06:50.867999 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:06:52.105693 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:06:52.105791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:06:52.105863 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:06:52.105930 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:06:52.105994 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:06:52.106063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:06:52.106128 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:06:52.425242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:07:20.998078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:07:20.998162 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:07:20.998245 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:07:20.998313 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:07:20.998377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:07:20.998448 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:07:20.998514 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:07:21.307338 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:07:21.576229 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:07:21.576325 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:07:21.576399 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:07:21.576474 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:07:21.576542 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:07:21.576614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:07:21.576708 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:07:21.882378 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:07:22.687848 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:07:22.687933 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:07:22.688001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:07:22.688062 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:07:22.688128 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:07:22.688189 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:07:22.688255 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:07:22.988356 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:07:51.578690 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:07:51.579227 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:07:51.579748 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:07:51.579850 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:07:51.579919 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:07:51.579999 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:07:51.580078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:07:51.895076 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:07:53.246479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:07:53.246569 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:07:53.246641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:07:53.246706 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:07:53.246778 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:07:53.246843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:07:53.246910 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:07:53.556362 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:08:21.121651 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:08:21.121747 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:08:21.121833 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:08:21.121896 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:08:21.121959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:08:21.122025 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:08:21.122086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:08:21.432403 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:08:22.166977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:08:22.167062 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:08:22.167130 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:08:22.167190 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:08:22.167259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:08:22.167341 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:08:22.167416 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:08:22.473017 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:08:23.818584 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:08:23.818685 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:08:23.818755 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:08:23.818817 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:08:23.818880 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:08:23.818939 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:08:23.819000 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:08:24.129650 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:08:52.732386 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:08:52.732471 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:08:52.732537 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:08:52.732603 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:08:52.732666 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:08:52.732736 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:08:52.732803 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:08:53.042888 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:08:54.402430 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:08:54.402541 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:08:54.402614 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:08:54.402708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:08:54.402780 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:08:54.402877 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:08:54.402943 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:08:54.712894 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:09:21.242621 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:09:21.242706 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:09:21.242779 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:09:21.242845 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:09:21.242909 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:09:21.242977 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:09:21.243043 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:09:21.553217 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:09:23.302885 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:09:23.302985 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:09:23.303046 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:09:23.303111 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:09:23.303179 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:09:23.303237 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:09:23.303306 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:09:23.621461 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:09:24.979992 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:09:24.980080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:09:24.980154 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:09:24.980221 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:09:24.980283 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:09:24.980346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:09:24.980407 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:09:25.292891 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:09:53.887538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:09:53.887621 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:09:53.887708 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:09:53.887780 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:09:53.887843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:09:53.887914 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:09:53.887972 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:09:54.194805 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:09:55.556881 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:09:55.556971 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:09:55.557033 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:09:55.557106 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:09:55.557175 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:09:55.557239 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:09:55.557301 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:09:55.866294 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:10:21.367026 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:10:21.367115 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:10:21.367178 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:10:21.367246 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:10:21.367310 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:10:21.367378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:10:21.367441 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:10:21.674365 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:10:24.459904 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:10:24.460017 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:10:24.460079 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:10:24.460148 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:10:24.460209 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:10:24.460284 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:10:24.460349 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:10:24.771394 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:10:26.130234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:10:26.130318 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:10:26.130384 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:10:26.130449 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:10:26.130514 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:10:26.130585 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:10:26.130655 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:10:26.438058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:10:55.038642 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:10:55.038739 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:10:55.038802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:10:55.038877 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:10:55.038947 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:10:55.039011 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:10:55.039068 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:10:55.355881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:10:56.704651 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:10:56.704751 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:10:56.704810 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:10:56.704877 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:10:56.704936 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:10:56.704995 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:10:56.705054 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:10:57.013942 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:11:21.490177 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:11:21.490264 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:11:21.490332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:11:21.490402 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:11:21.490465 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:11:21.490535 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:11:21.490599 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:11:21.811020 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:11:25.621909 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:11:25.622005 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:11:25.622081 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:11:25.622156 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:11:25.622226 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:11:25.622297 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:11:25.622361 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:11:25.937101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:11:27.278695 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:11:27.278810 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:11:27.278881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:11:27.278945 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:11:27.279012 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:11:27.279074 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:11:27.279139 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:11:27.583356 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:11:56.197640 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:11:56.197735 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:11:56.197799 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:11:56.197869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:11:56.197928 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:11:56.197993 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:11:56.198053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:11:56.509113 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:11:57.848609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:11:57.848692 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:11:57.848770 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:11:57.848836 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:11:57.848901 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:11:57.848968 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:11:57.849039 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:11:58.153644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:12:21.568819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:12:21.568912 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:12:21.569005 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:12:21.569085 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:12:21.569159 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:12:21.569234 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:12:21.569307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:12:21.881126 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:12:26.773576 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:12:26.773678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:12:26.773767 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:12:26.773846 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:12:26.773921 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:12:26.773990 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:12:26.774067 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:12:27.102803 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:12:28.416049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:12:28.416159 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:12:28.416249 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:12:28.416332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:12:28.416407 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:12:28.416482 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:12:28.416553 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:12:28.717767 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:12:57.369523 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:12:57.369625 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:12:57.369699 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:12:57.369792 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:12:57.369880 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:12:57.369955 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:12:57.370030 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:12:57.677896 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:12:58.994640 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:12:58.994759 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:12:58.994840 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:12:58.994915 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:12:58.994998 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:12:58.995076 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:12:58.995152 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:12:59.303272 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:13:21.691505 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:13:21.691616 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:13:21.691691 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:13:21.691811 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:13:21.691885 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:13:21.691963 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:13:21.692041 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:13:21.993064 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:13:27.938530 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:13:27.938614 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:13:27.938709 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:13:27.938785 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:13:27.938860 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:13:27.938928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:13:27.938993 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:13:28.235361 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:13:29.569274 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:13:29.569397 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:13:29.569475 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:13:29.569553 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:13:29.569626 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:13:29.569708 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:13:29.569796 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:13:29.868289 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:13:58.496232 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:13:58.496323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:13:58.496411 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:13:58.496493 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:13:58.496578 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:13:58.496651 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:13:58.496736 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:13:58.793457 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:14:00.137316 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:14:00.137435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:14:00.137504 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:14:00.137568 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:14:00.137655 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:14:00.137728 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:14:00.137804 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:14:00.444067 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:14:21.810142 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:14:21.810230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:14:21.810300 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:14:21.810367 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:14:21.810436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:14:21.810499 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:14:21.810566 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:14:22.135570 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:14:29.054243 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:14:29.054352 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:14:29.054416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:14:29.054972 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:14:29.055416 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:14:29.055580 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:14:29.055872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:14:29.373576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:14:30.703982 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:14:30.704089 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:14:30.704148 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:14:30.704216 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:14:30.704282 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:14:30.704345 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:14:30.704410 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:14:31.015729 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:14:59.634960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:14:59.635093 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:14:59.635152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:14:59.635216 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:14:59.635278 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:14:59.635338 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:14:59.635398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:14:59.950538 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:15:01.278991 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:15:01.279094 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:15:01.279176 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:15:01.279256 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:15:01.279332 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:15:01.279409 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:15:01.279489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:15:01.581790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:15:21.940186 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:15:21.940280 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:15:21.940355 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:15:21.940436 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:15:21.940509 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:15:21.940591 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:15:21.940655 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:15:22.273592 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:15:30.214769 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:15:30.214877 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:15:30.214959 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:15:30.215051 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:15:30.215126 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:15:30.215207 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:15:30.215297 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:15:30.516861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:15:31.851834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:15:31.851944 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:15:31.852070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:15:31.852157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:15:31.852244 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:15:31.852349 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:15:31.852436 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:15:32.169168 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:16:00.771607 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:16:00.771715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:16:00.771793 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:16:00.771863 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:16:00.771929 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:16:00.771989 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:16:00.772054 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:16:01.079679 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:16:02.443373 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:16:02.443467 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:16:02.443552 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:16:02.443631 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:16:02.443728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:16:02.443805 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:16:02.443896 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:16:02.749271 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:16:22.069328 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:16:22.069422 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:16:22.069519 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:16:22.069598 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:16:22.069680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:16:22.069774 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:16:22.069868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:16:22.390566 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:16:31.339912 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:16:31.340009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:16:31.340090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:16:31.340165 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:16:31.340240 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:16:31.340311 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:16:31.340395 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:16:31.648175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:16:33.011568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:16:33.011691 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:16:33.011814 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:16:33.011915 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:16:33.012008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:16:33.012103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:16:33.012195 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:16:33.317096 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:17:01.912314 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:17:01.912421 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:17:01.912511 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:17:01.912599 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:17:01.912684 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:17:01.912772 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:17:01.912853 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:17:02.230596 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:17:03.578248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:17:03.578343 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:17:03.578422 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:17:03.578498 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:17:03.578569 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:17:03.578640 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:17:03.578721 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:17:03.899002 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:17:22.203513 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:17:22.203610 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:17:22.203696 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:17:22.203790 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:17:22.203882 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:17:22.203960 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:17:22.204041 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:17:22.510110 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:17:32.497211 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:17:32.497313 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:17:32.497407 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:17:32.497490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:17:32.497561 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:17:32.497640 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:17:32.497737 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:17:32.800805 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:17:34.165288 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:17:34.165401 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:17:34.165482 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:17:34.165556 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:17:34.165627 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:17:34.165705 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:17:34.165793 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:17:34.475551 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:18:03.067572 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:18:03.067696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:18:03.067777 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:18:03.067856 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:18:03.067938 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:18:03.068011 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:18:03.068083 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:18:03.375957 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:18:04.737774 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:18:04.737857 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:18:04.737924 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:18:04.737994 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:18:04.738055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:18:04.738122 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:18:04.738186 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:18:05.062590 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:18:22.336787 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:18:22.336870 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:18:22.336938 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:18:22.337006 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:18:22.337077 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:18:22.337137 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:18:22.337201 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:18:22.646390 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:18:33.637782 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:18:33.637893 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:18:33.637966 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:18:33.638059 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:18:33.638133 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:18:33.638204 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:18:33.638273 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:18:33.946729 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:18:35.323713 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:18:35.323813 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:18:35.323882 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:18:35.323950 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:18:35.324015 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:18:35.324081 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:18:35.324148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:18:35.633075 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:19:04.213075 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:19:04.213163 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:19:04.213229 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:19:04.213298 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:19:04.213367 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:19:04.213435 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:19:04.213496 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:19:04.520860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:19:05.894302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:19:05.894383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:19:05.894449 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:19:05.894507 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:19:05.894576 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:19:05.894632 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:19:05.894697 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:19:06.198142 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:19:22.465642 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:19:22.465731 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:19:22.465800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:19:22.465866 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:19:22.465934 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:19:22.465995 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:19:22.466060 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:19:22.768796 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:19:34.776746 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:19:34.776840 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:19:34.776904 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:19:34.776969 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:19:34.777031 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:19:34.777096 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:19:34.777158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:19:35.090113 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:19:36.457448 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:19:36.457565 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:19:36.457625 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:19:36.457691 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:19:36.457766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:19:36.457833 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:19:36.457892 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:19:36.762527 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:20:05.350339 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:20:05.350452 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:20:05.350546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:20:05.350635 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:20:05.350712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:20:05.350801 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:20:05.350878 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:20:05.652029 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:20:07.028262 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:20:07.028935 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:20:07.029255 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:20:07.029629 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:20:07.030181 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:20:07.030782 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:20:07.031500 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:20:07.335991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:20:22.592843 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:20:22.592937 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:20:22.593000 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:20:22.593068 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:20:22.593132 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:20:22.593203 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:20:22.593262 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:20:22.900378 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:20:35.924858 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:20:35.924959 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:20:35.925047 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:20:35.925168 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:20:35.925253 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:20:35.925360 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:20:35.925501 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:20:36.238823 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:20:37.598647 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:20:37.598741 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:20:37.598813 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:20:37.598873 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:20:37.598938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:20:37.599002 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:20:37.599067 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:20:37.910203 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:21:06.498483 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:21:06.498590 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:21:06.498666 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:21:06.498748 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:21:06.498822 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:21:06.498896 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:21:06.498965 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:21:06.815623 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:21:08.180727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:21:08.180816 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:21:08.180878 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:21:08.180946 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:21:08.181008 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:21:08.181080 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:21:08.181139 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:21:08.486492 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:21:22.724879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:21:22.724953 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:21:22.725026 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:21:22.725098 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:21:22.725165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:21:22.725223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:21:22.725290 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:21:23.040048 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:21:37.081884 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:21:37.081969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:21:37.082035 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:21:37.082097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:21:37.082164 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:21:37.082227 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:21:37.082292 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:21:37.383036 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:21:38.749465 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:21:38.749547 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:21:38.749624 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:21:38.749693 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:21:38.749761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:21:38.749828 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:21:38.749889 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:21:39.058017 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:22:07.646246 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:22:07.646326 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:22:07.646399 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:22:07.646462 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:22:07.646529 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:22:07.646590 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:22:07.646660 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:22:07.948136 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:22:09.320456 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:22:09.320535 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:22:09.320608 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:22:09.320678 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:22:09.320754 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:22:09.320818 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:22:09.320887 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:22:09.625234 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:22:22.851955 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:22:22.852310 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:22:22.852659 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:22:22.853801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:22:22.853946 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:22:22.854037 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:22:22.854141 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:22:23.157781 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:22:38.209546 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:22:38.209631 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:22:38.209706 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:22:38.209777 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:22:38.209853 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:22:38.209923 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:22:38.209994 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:22:38.518988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:22:39.883851 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:22:39.883933 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:22:39.884009 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:22:39.884070 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:22:39.884134 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:22:39.884196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:22:39.884261 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:22:40.208258 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:23:08.783999 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:23:08.784081 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:23:08.784152 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:23:08.784217 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:23:08.784278 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:23:08.784340 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:23:08.784406 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:23:09.096975 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:23:10.467816 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:23:10.467925 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:23:10.468014 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:23:10.468085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:23:10.468167 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:23:10.468261 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:23:10.468341 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:23:10.768879 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:23:22.979427 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:23:22.979521 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:23:22.979600 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:23:22.979673 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:23:22.979748 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:23:22.979822 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:23:22.979893 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:23:23.282150 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:23:39.364967 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:23:39.365064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:23:39.365161 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:23:39.365244 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:23:39.365363 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:23:39.365439 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:23:39.365537 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:23:39.667373 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:23:41.034147 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:23:41.034246 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:23:41.034331 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:23:41.034408 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:23:41.034477 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:23:41.034565 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:23:41.034653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:23:41.341193 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:24:09.927789 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:24:09.927898 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:24:09.927971 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:24:09.928049 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:24:09.928127 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:24:09.928210 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:24:09.928285 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:24:10.242372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:24:11.608369 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:24:11.608486 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:24:11.608556 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:24:11.608631 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:24:11.608702 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:24:11.608780 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:24:11.608848 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:24:11.923146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:24:23.111043 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:24:23.111136 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:24:23.111213 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:24:23.111301 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:24:23.111375 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:24:23.111458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:24:23.111535 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:24:23.419299 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:24:40.502100 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:24:40.502197 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:24:40.502271 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:24:40.502343 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:24:40.502417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:24:40.502488 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:24:40.502557 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:24:40.810359 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:24:42.207627 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:24:42.207707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:24:42.207781 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:24:42.207851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:24:42.207932 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:24:42.207992 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:24:42.208059 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:24:42.523843 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:25:11.067319 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:25:11.067435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:25:11.067505 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:25:11.067567 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:25:11.067634 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:25:11.067696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:25:11.067762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:25:11.370796 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:25:12.786949 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:25:12.787078 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:25:12.787143 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:25:12.787205 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:25:12.787272 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:25:12.787330 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:25:12.787399 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:25:13.095575 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:25:23.235643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:25:23.235776 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:25:23.235858 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:25:23.235943 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:25:23.236018 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:25:23.236118 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:25:23.236196 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:25:23.545139 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:25:41.636706 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:25:41.636800 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:25:41.636880 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:25:41.636958 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:25:41.637037 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:25:41.637112 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:25:41.637194 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:25:41.946586 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:25:43.358938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:25:43.359040 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:25:43.359117 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:25:43.359198 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:25:43.359285 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:25:43.359368 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:25:43.359443 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:25:43.667197 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:26:12.207194 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:26:12.207285 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:26:12.207351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:26:12.207425 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:26:12.207487 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:26:12.207556 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:26:12.207618 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:26:12.514917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:26:13.929802 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:26:13.929898 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:26:13.929967 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:26:13.930033 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:26:13.930101 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:26:13.930159 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:26:13.930224 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:26:14.241022 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:26:23.375244 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:26:23.375345 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:26:23.375418 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:26:23.375502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:26:23.375575 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:26:23.375649 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:26:23.375724 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:26:23.683056 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:26:42.776347 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:26:42.776445 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:26:42.776535 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:26:42.776614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:26:42.776691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:26:42.776772 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:26:42.776867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:26:43.076576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:26:44.510145 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:26:44.510249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:26:44.510328 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:26:44.510403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:26:44.510475 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:26:44.510543 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:26:44.510621 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:26:44.817575 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:27:13.333101 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:27:13.333203 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:27:13.333296 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:27:13.333395 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:27:13.333488 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:27:13.333580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:27:13.333678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:27:13.634982 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:27:15.084641 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:27:15.084750 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:27:15.084841 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:27:15.084921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:27:15.084992 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:27:15.085074 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:27:15.085151 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:27:15.389711 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:27:23.501586 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:27:23.501675 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:27:23.501762 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:27:23.501829 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:27:23.501906 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:27:23.501979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:27:23.502052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:27:23.807199 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:27:43.901572 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:27:43.901668 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:27:43.901756 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:27:43.901834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:27:43.901897 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:27:43.901959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:27:43.902023 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:27:44.210536 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:27:45.650154 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:27:45.650236 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:27:45.650309 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:27:45.650372 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:27:45.650438 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:27:45.650499 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:27:45.650559 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:27:45.949296 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:28:14.473744 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:28:14.473834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:28:14.473899 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:28:14.473962 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:28:14.474025 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:28:14.474091 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:28:14.474158 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:28:14.782269 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:28:16.206523 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:28:16.206944 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:28:16.207355 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:28:16.207444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:28:16.207521 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:28:16.207589 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:28:16.207678 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:28:16.521187 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:28:23.627683 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:28:23.627782 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:28:23.627863 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:28:23.627933 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:28:23.628004 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:28:23.628074 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:28:23.628139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:28:23.932697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:28:45.045316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:28:45.045407 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:28:45.045476 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:28:45.045539 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:28:45.045599 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:28:45.045671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:28:45.045733 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:28:45.356674 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:28:46.785574 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:28:46.785687 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:28:46.785757 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:28:46.785821 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:28:46.785884 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:28:46.785948 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:28:46.786007 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:28:47.090296 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:29:15.617211 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:29:15.617310 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:29:15.617380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:29:15.617453 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:29:15.617519 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:29:15.617586 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:29:15.617643 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:29:15.919623 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:29:17.350196 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:29:17.350294 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:29:17.350358 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:29:17.350420 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:29:17.350489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:29:17.350548 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:29:17.350614 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:29:17.652634 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:29:23.755987 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:29:23.756078 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:29:23.757051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:29:23.757305 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:29:23.757466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:29:23.757967 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:29:23.758868 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:29:24.079974 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:29:46.182062 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:29:46.182150 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:29:46.182217 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:29:46.182284 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:29:46.182352 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:29:46.182415 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:29:46.182473 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:29:46.484915 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:29:47.922219 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:29:47.922348 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:29:47.922432 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:29:47.922522 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:29:47.922598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:29:47.922675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:29:47.922762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:29:48.223215 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:30:16.748990 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:30:16.749089 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:30:16.749173 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:30:16.749254 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:30:16.749336 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:30:16.749407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:30:16.749491 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:30:17.049072 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:30:18.488270 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:30:18.488373 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:30:18.488444 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:30:18.488520 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:30:18.488590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:30:18.488674 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:30:18.488753 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:30:18.790348 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:30:23.884153 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:30:23.884235 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:30:23.884301 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:30:23.884366 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:30:23.884432 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:30:23.884491 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:30:23.884552 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:30:24.212187 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:30:47.308396 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:30:47.308860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:30:47.309143 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:30:47.309706 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:30:47.309793 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:30:47.309886 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:30:47.309956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:30:47.622775 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:30:49.053661 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:30:49.053760 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:30:49.053827 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:30:49.053898 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:30:49.053961 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:30:49.054024 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:30:49.054085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:30:49.362646 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:31:17.884684 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:31:17.884772 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:31:17.884841 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:31:17.884905 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:31:17.884966 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:31:17.885028 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:31:17.885097 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:31:18.193783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:31:19.626382 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:31:19.626463 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:31:19.626527 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:31:19.626589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:31:19.626649 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:31:19.626714 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:31:19.626784 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:31:19.944730 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:31:24.006403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:31:24.006484 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:31:24.006544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:31:24.006622 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:31:24.006686 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:31:24.006758 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:31:24.006825 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:31:24.311918 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:31:48.455840 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:31:48.455930 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:31:48.456002 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:31:48.456068 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:31:48.456135 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:31:48.456197 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:31:48.456274 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:31:48.761575 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:31:50.215138 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:31:50.215232 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:31:50.215304 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:31:50.215371 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:31:50.215475 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:31:50.215553 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:31:50.215632 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:31:50.526959 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:32:19.032135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:32:19.032220 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:32:19.032292 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:32:19.032357 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:32:19.032427 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:32:19.032489 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:32:19.032556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:32:19.341219 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:32:20.793479 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:32:20.793567 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:32:20.793625 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:32:20.793697 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:32:20.793764 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:32:20.793825 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:32:20.793890 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:32:21.107058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:32:24.136936 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:32:24.137015 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:32:24.137102 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:32:24.137166 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:32:24.137228 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:32:24.137290 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:32:24.137354 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:32:24.447707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:32:49.611048 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:32:49.611152 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:32:49.611227 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:32:49.611293 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:32:49.611355 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:32:49.611427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:32:49.611499 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:32:49.921580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:32:51.370413 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:32:51.370513 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:32:51.370602 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:32:51.370681 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:32:51.370770 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:32:51.370850 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:32:51.370937 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:32:51.684311 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:33:20.192278 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:33:20.192378 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:33:20.192468 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:33:20.192557 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:33:20.192639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:33:20.192712 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:33:20.192806 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:33:20.497843 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:33:21.943780 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:33:21.943882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:33:21.943958 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:33:21.944034 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:33:21.944111 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:33:21.944187 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:33:21.944259 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:33:22.281822 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:33:24.272078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:33:24.272208 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:33:24.272291 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:33:24.272380 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:33:24.272454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:33:24.272539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:33:24.272622 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:33:24.579553 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:33:50.761666 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:33:50.761782 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:33:50.761860 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:33:50.761934 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:33:50.762009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:33:50.762082 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:33:50.762157 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:33:51.068327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:33:52.541231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:33:52.541322 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:33:52.541386 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:33:52.541459 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:33:52.541523 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:33:52.541583 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:33:52.541643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:33:52.849414 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:34:21.329404 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:34:21.329517 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:34:21.329606 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:34:21.329682 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:34:21.329787 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:34:21.329870 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:34:21.329961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:34:21.630148 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:34:23.111797 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:34:23.111893 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:34:23.111968 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:34:23.112036 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:34:23.112112 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:34:23.112183 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:34:23.112253 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:34:23.412106 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:34:24.397416 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:34:24.397498 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:34:24.397566 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:34:24.397630 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:34:24.397696 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:34:24.397760 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:34:24.397827 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:34:24.712727 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:34:51.905160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:34:51.905262 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:34:51.905341 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:34:51.905422 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:34:51.905495 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:34:51.905576 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:34:51.905659 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:34:52.241100 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:34:53.673682 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:34:53.673810 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:34:53.673892 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:34:53.673982 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:34:53.674064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:34:53.674143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:34:53.674224 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:34:53.977159 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:35:22.503315 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:35:22.503447 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:35:22.503538 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:35:22.503621 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:35:22.503694 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:35:22.503784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:35:22.503861 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:35:22.807539 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:35:24.248648 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:35:24.248775 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:35:24.248866 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:35:24.248983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:35:24.249080 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:35:24.249166 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:35:24.249253 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:35:24.567864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:35:24.828267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:35:24.828371 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:35:24.828436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:35:24.828513 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:35:24.828583 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:35:24.828644 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:35:24.828710 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:35:25.147440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:35:53.063080 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:35:53.063181 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:35:53.063268 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:35:53.063346 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:35:53.063430 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:35:53.063507 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:35:53.063590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:35:53.380911 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:35:54.829966 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:35:54.830085 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:35:54.830156 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:35:54.830230 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:35:54.830303 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:35:54.830396 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:35:54.830470 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:35:55.148901 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:36:23.645035 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:36:23.645150 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:36:23.645236 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:36:23.645323 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:36:23.645400 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:36:23.645488 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:36:23.645573 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:36:23.953873 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:36:24.651116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:36:24.651209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:36:24.651288 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:36:24.651363 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:36:24.651437 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:36:24.651510 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:36:24.651588 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:36:24.955988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:36:25.419376 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:36:25.419479 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:36:25.419560 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:36:25.419627 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:36:25.419692 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:36:25.419769 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:36:25.419846 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:36:25.723536 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:36:54.237977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:36:54.238078 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:36:54.238145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:36:54.238217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:36:54.238280 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:36:54.238338 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:36:54.238404 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:36:54.551060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:36:55.991909 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:36:55.992033 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:36:55.992106 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:36:55.992192 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:36:55.992273 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:36:55.992348 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:36:55.992425 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:36:56.300286 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:37:24.786779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:37:24.786868 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:37:24.786953 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:37:24.787027 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:37:24.787090 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:37:24.787169 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:37:24.787239 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:37:25.118853 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:37:25.380164 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:37:25.380243 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:37:25.380311 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:37:25.380380 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:37:25.380448 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:37:25.380511 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:37:25.380576 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:37:25.676308 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:37:26.562526 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:37:26.562639 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:37:26.562723 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:37:26.562820 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:37:26.562894 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:37:26.564151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:37:26.564434 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:37:26.870175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:37:55.382614 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:37:55.382734 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:37:55.382807 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:37:55.382877 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:37:55.382939 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:37:55.383010 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:37:55.383080 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:37:55.688204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:37:57.133637 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:37:57.133762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:37:57.133849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:37:57.133931 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:37:57.134010 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:37:57.134088 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:37:57.134166 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:37:57.435733 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:38:24.914534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:38:24.914654 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:38:24.914747 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:38:24.914851 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:38:24.914936 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:38:24.915020 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:38:24.915103 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:38:25.228102 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:38:25.949613 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:38:25.949730 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:38:25.949807 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:38:25.949878 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:38:25.949953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:38:25.950034 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:38:25.950109 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:38:26.254916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:38:27.697004 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:38:27.697085 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:38:27.697151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:38:27.697221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:38:27.697280 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:38:27.697352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:38:27.697420 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:38:28.006396 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:38:56.520843 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:38:56.521030 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:38:56.521183 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:38:56.521328 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:38:56.521495 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:38:56.521697 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:38:56.521900 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:38:56.835817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:38:58.273193 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:38:58.273296 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:38:58.273364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:38:58.273430 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:38:58.273494 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:38:58.273562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:38:58.273624 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:38:58.579530 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:39:25.039436 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:39:25.039532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:39:25.039623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:39:25.039693 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:39:25.039786 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:39:25.039879 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:39:25.039954 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:39:25.347447 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:39:27.096337 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:39:27.096435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:39:27.096503 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:39:27.096575 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:39:27.096652 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:39:27.096753 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:39:27.096820 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:39:27.399159 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:39:28.840487 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:39:28.840593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:39:28.840663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:39:28.840753 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:39:28.840828 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:39:28.840907 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:39:28.840971 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:39:29.162983 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:39:57.661884 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:39:57.661980 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:39:57.662063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:39:57.662135 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:39:57.662208 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:39:57.662281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:39:57.662360 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:39:57.968092 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:39:59.428299 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:39:59.428398 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:39:59.428475 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:39:59.428552 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:39:59.428627 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:39:59.428711 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:39:59.428786 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:39:59.736515 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:40:25.165815 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:40:25.165901 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:40:25.165966 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:40:25.166040 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:40:25.166103 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:40:25.166171 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:40:25.166236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:40:25.472349 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 05:40:28.230681 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:40:28.230773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:40:28.230836 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:40:28.230899 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:40:28.230961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:40:28.231025 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:40:28.231087 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:40:28.539930 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 05:40:29.997190 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:40:29.997303 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:40:29.997381 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:40:29.997475 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:40:29.997547 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:40:29.997622 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:40:29.997695 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:40:30.318706 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:40:58.799879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:40:58.799960 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:40:58.800052 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:40:58.800124 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:40:58.800200 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:40:58.800269 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:40:58.800338 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:40:59.111111 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:41:00.579436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:41:00.579542 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:41:00.579614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:41:00.579677 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:41:00.579746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:41:00.579810 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:41:00.579881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:41:00.885664 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:41:25.296211 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:41:25.296293 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:41:25.296363 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:41:25.296438 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:41:25.296512 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:41:25.296581 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:41:25.296644 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:41:25.599837 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:41:29.380027 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:41:29.380147 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:41:29.380228 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:41:29.380306 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:41:29.380382 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:41:29.380461 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:41:29.380554 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:41:29.683623 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:41:31.161659 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:41:31.161772 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:41:31.161847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:41:31.161930 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:41:31.162011 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:41:31.162091 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:41:31.162165 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:41:31.465776 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:41:59.957119 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:41:59.957226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:41:59.957304 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:41:59.957395 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:41:59.957468 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:41:59.957540 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:41:59.957604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:42:00.269444 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:42:01.728969 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:42:01.729099 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:42:01.729177 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:42:01.729242 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:42:01.729299 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:42:01.729360 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:42:01.729423 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:42:02.072343 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:42:25.422409 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:42:25.422489 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:42:25.423690 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:42:25.424248 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:42:25.424453 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:42:25.424597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:42:25.424811 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:42:25.724810 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:42:30.528562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:42:30.528657 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:42:30.528734 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:42:30.528798 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:42:30.528866 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:42:30.528931 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:42:30.529002 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:42:30.844267 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:42:32.347879 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:42:32.347982 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:42:32.348063 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:42:32.348141 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:42:32.348223 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:42:32.348299 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:42:32.348376 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:42:32.648270 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:43:01.108091 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:43:01.108176 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:43:01.108259 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:43:01.108337 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:43:01.108407 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:43:01.108478 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:43:01.108544 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:43:01.416130 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:43:02.906474 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:43:02.906563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:43:02.906629 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:43:02.906692 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:43:02.906768 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:43:02.906833 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:43:02.906892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:43:03.209530 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:43:25.549984 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:43:25.550071 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:43:25.550144 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:43:25.550211 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:43:25.550276 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:43:25.550337 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:43:25.550407 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:43:25.858603 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:43:31.674432 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:43:31.675541 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:43:31.676168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:43:31.677156 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:43:31.678037 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:43:31.678172 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:43:31.678278 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:43:31.994184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:43:33.466921 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:43:33.467024 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:43:33.467092 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:43:33.467160 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:43:33.467253 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:43:33.467328 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:43:33.467412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:43:33.773124 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:44:02.291407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:44:02.291498 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:44:02.291563 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:44:02.291628 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:44:02.291693 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:44:02.291769 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:44:02.291831 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:44:02.594317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:44:04.039940 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:44:04.040039 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:44:04.040132 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:44:04.040216 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:44:04.040295 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:44:04.040391 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:44:04.040478 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:44:04.345404 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:44:25.680831 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:44:25.680915 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:44:25.680995 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:44:25.681063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:44:25.681134 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:44:25.681203 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:44:25.681289 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:44:25.985454 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:44:32.854850 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:44:32.854931 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:44:32.855012 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:44:32.855075 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:44:32.855139 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:44:32.855207 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:44:32.855279 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:44:33.164077 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:44:34.599125 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:44:34.599239 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:44:34.599307 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:44:34.599377 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:44:34.599445 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:44:34.599502 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:44:34.599568 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:44:34.910446 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:45:03.421953 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:45:03.422035 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:45:03.422099 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:45:03.422176 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:45:03.422239 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:45:03.422307 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:45:03.422374 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:45:03.728621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:45:05.175648 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:45:05.175740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:45:05.175805 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:45:05.175871 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:45:05.175937 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:45:05.176005 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:45:05.176065 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:45:05.479339 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:45:25.800607 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:45:25.800702 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:45:25.800783 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:45:25.800857 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:45:25.800936 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:45:25.801002 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:45:25.801073 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:45:26.097801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:45:33.990074 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:45:33.990155 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:45:33.990215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:45:33.990284 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:45:33.990351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:45:33.990414 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:45:33.990476 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:45:34.298778 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:45:35.741941 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:45:35.742019 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:45:35.742085 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:45:35.742149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:45:35.742204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:45:35.742270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:45:35.742333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:45:36.048924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:46:04.562747 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:46:04.562830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:46:04.562901 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:46:04.562965 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:46:04.563038 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:46:04.563097 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:46:04.563167 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:46:04.872242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:46:06.315079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:46:06.315178 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:46:06.315260 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:46:06.315346 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:46:06.315421 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:46:06.315512 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:46:06.315590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:46:06.620878 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:46:25.918844 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:46:25.918925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:46:25.918996 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:46:25.919070 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:46:25.919146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:46:25.919219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:46:25.919283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:46:26.218351 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:46:35.143807 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:46:35.143899 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:46:35.143983 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:46:35.144051 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:46:35.144114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:46:35.144176 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:46:35.144239 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:46:35.458710 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:46:36.879835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:46:36.879917 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:46:36.879997 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:46:36.880062 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:46:36.880120 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:46:36.880178 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:46:36.880248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:46:37.192004 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:47:05.720898 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:47:05.721002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:47:05.721096 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:47:05.721222 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:47:05.721300 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:47:05.721397 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:47:05.721496 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:47:06.023015 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:47:07.452206 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:47:07.452315 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:47:07.452396 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:47:07.452460 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:47:07.452529 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:47:07.452587 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:47:07.452653 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:47:07.760112 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:47:26.043116 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:47:26.043224 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:47:26.043290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:47:26.043356 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:47:26.043422 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:47:26.043502 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:47:26.043565 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:47:26.352586 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:47:36.280258 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:47:36.280343 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:47:36.280424 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:47:36.280489 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:47:36.280551 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:47:36.280613 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:47:36.280672 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:47:36.585227 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:47:38.032833 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:47:38.032939 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:47:38.033014 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:47:38.033072 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:47:38.033138 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:47:38.033200 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:47:38.033264 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:47:38.332998 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:48:06.841999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:48:06.842095 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:48:06.842157 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:48:06.842223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:48:06.842280 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:48:06.842344 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:48:06.842410 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:48:07.149522 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:48:08.596130 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:48:08.596234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:48:08.596301 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:48:08.596369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:48:08.596435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:48:08.596501 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:48:08.596566 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:48:08.896674 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:48:26.166616 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:48:26.166705 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:48:26.166806 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:48:26.166887 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:48:26.166966 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:48:26.167045 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:48:26.167122 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:48:26.471256 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:48:37.407460 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:48:37.407561 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:48:37.407632 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:48:37.407705 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:48:37.407788 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:48:37.407863 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:48:37.407934 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:48:37.714455 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:48:39.160131 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:48:39.160241 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:48:39.160318 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:48:39.160379 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:48:39.160437 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:48:39.160502 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:48:39.160561 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:48:39.463733 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:49:07.977570 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:49:07.977657 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:49:07.977736 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:49:07.977809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:49:07.977887 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:49:07.977952 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:49:07.978048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:49:08.282203 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:49:09.724478 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:49:09.724560 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:49:09.724633 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:49:09.724695 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:49:09.724763 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:49:09.724833 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:49:09.724895 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:49:10.037236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:49:26.290095 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:49:26.290188 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:49:26.290250 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:49:26.290320 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:49:26.290385 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:49:26.290448 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:49:26.290509 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:49:26.599018 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:49:38.543186 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:49:38.543282 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:49:38.543358 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:49:38.543435 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:49:38.543518 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:49:38.543600 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:49:38.543681 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:49:38.842168 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:49:40.300715 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:49:40.300821 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:49:40.300897 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:49:40.300971 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:49:40.301041 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:49:40.301107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:49:40.301185 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:49:40.610606 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:50:09.105970 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:50:09.106057 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:50:09.106120 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:50:09.106178 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:50:09.106245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:50:09.106320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:50:09.106381 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:50:09.409572 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:50:10.866696 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:50:10.866780 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:50:10.866857 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:50:10.866922 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:50:10.866985 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:50:10.867044 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:50:10.867104 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:50:11.176826 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:50:26.416357 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:50:26.416469 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:50:26.416549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:50:26.416643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:50:26.416733 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:50:26.416819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:50:26.418043 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:50:26.725562 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:50:39.674894 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:50:39.674979 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:50:39.675057 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:50:39.675122 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:50:39.675224 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:50:39.675316 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:50:39.675387 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:50:39.979631 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:50:41.440318 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:50:41.440417 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:50:41.440495 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:50:41.440582 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:50:41.440662 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:50:41.440756 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:50:41.440833 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:50:41.750796 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:51:10.250284 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:51:10.250384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:51:10.250471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:51:10.250549 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:51:10.250625 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:51:10.250705 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:51:10.250787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:51:10.557356 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:51:12.011445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:51:12.011568 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:51:12.011646 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:51:12.011724 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:51:12.011798 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:51:12.011872 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:51:12.011942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:51:12.325636 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:51:26.538150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:51:26.538253 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:51:26.538338 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:51:26.538425 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:51:26.538504 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:51:26.538603 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:51:26.538677 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:51:26.839397 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:51:40.821159 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:51:40.821266 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:51:40.821334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:51:40.821404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:51:40.821473 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:51:40.821546 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:51:40.821618 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:51:41.136809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:51:42.582837 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:51:42.582930 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:51:42.583006 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:51:42.583072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:51:42.583133 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:51:42.583195 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:51:42.583254 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:51:42.891982 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:52:11.401614 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:52:11.401733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:52:11.401813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:52:11.401905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:52:11.401972 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:52:11.402032 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:52:11.402096 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:52:11.703550 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:52:13.154572 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:52:13.154661 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:52:13.154739 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:52:13.154803 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:52:13.154866 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:52:13.154927 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:52:13.154990 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:52:13.459391 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:52:26.665764 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:52:26.665847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:52:26.665917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:52:26.665987 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:52:26.666050 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:52:26.666116 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:52:26.666180 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:52:26.988979 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:52:41.983433 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:52:41.983512 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:52:41.984352 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:52:41.984662 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:52:41.985324 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:52:41.985776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:52:41.986069 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:52:42.310613 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:52:43.719670 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:52:43.719764 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:52:43.719832 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:52:43.719902 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:52:43.719964 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:52:43.720036 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:52:43.720107 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:52:44.036376 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:53:12.571968 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:53:12.572073 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:53:12.572146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:53:12.572217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:53:12.572280 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:53:12.572365 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:53:12.572427 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:53:12.872004 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:53:14.303980 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:53:14.304065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:53:14.304142 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:53:14.304214 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:53:14.304280 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:53:14.304344 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:53:14.304406 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:53:14.615802 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:53:26.789577 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:53:26.789658 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:53:26.789732 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:53:26.789799 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:53:26.789864 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:53:26.789929 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:53:26.789993 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:53:27.104505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:53:43.129937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:53:43.130030 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:53:43.130094 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:53:43.130160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:53:43.130220 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:53:43.130289 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:53:43.130350 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:53:43.437821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:53:44.880206 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:53:44.880546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:53:44.880694 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:53:44.881485 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:53:44.881583 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:53:44.881653 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:53:44.881763 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:53:45.185636 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:54:13.739867 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:54:13.739957 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:54:13.740045 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:54:13.740113 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:54:13.740185 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:54:13.740257 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:54:13.740329 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:54:14.061038 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:54:15.451071 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:54:15.451187 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:54:15.451266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:54:15.451345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:54:15.451432 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:54:15.451508 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:54:15.451590 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:54:15.756756 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:54:26.912540 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:54:26.912643 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:54:26.912735 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:54:26.912812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:54:26.912900 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:54:26.912976 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:54:26.913050 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:54:27.223822 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:54:44.325487 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:54:44.325612 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:54:44.325688 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:54:44.325776 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:54:44.325857 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:54:44.325934 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:54:44.326022 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:54:44.635286 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:54:46.020234 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:54:46.020338 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:54:46.020404 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:54:46.020485 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:54:46.020557 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:54:46.020630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:54:46.020699 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:54:46.326238 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:55:14.897117 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:55:14.897199 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:55:14.897270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:55:14.897334 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:55:14.897396 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:55:14.897460 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:55:14.897526 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:55:15.205856 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:55:16.594579 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:55:16.594677 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:55:16.594770 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:55:16.594849 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:55:16.594920 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:55:16.594992 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:55:16.595065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:55:16.903638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:55:27.031674 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:55:27.031782 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:55:27.031873 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:55:27.031967 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:55:27.032058 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:55:27.032134 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:55:27.032214 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:55:27.335251 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:55:45.463290 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:55:45.463412 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:55:45.463493 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:55:45.463582 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:55:45.463663 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:55:45.463750 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:55:45.463829 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:55:45.766580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:55:47.170470 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:55:47.170569 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:55:47.170640 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:55:47.170729 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:55:47.170819 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:55:47.170906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:55:47.170983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:55:47.472612 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:56:16.021695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:56:16.021814 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:56:16.021898 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:56:16.021988 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:56:16.022074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:56:16.022144 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:56:16.022220 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:56:16.336884 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:56:17.746706 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:56:17.746845 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:56:17.746922 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:56:17.746996 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:56:17.747077 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:56:17.747162 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:56:17.747236 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:56:18.060036 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:56:27.152539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:56:27.152627 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:56:27.152697 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:56:27.152780 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:56:27.152850 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:56:27.152916 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:56:27.152983 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:56:27.457747 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:56:46.602443 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:56:46.602526 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:56:46.602606 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:56:46.602672 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:56:46.602748 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:56:46.602810 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:56:46.602884 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:56:46.910524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:56:48.326510 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:56:48.326596 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:56:48.326675 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:56:48.326743 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:56:48.326808 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:56:48.326873 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:56:48.326936 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:56:48.633870 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:57:17.173798 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:57:17.173885 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:57:17.173962 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:57:17.174031 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:57:17.174099 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:57:17.174156 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:57:17.174218 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:57:17.484489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:57:18.892825 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:57:18.892907 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:57:18.892980 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:57:18.893063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:57:18.893122 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:57:18.893190 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:57:18.893247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:57:19.200864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:57:27.272297 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:57:27.272398 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:57:27.272470 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:57:27.272540 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:57:27.272615 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:57:27.272678 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:57:27.272743 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:57:27.580218 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:57:47.754594 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:57:47.754679 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:57:47.754764 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:57:47.754826 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:57:47.754889 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:57:47.754951 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:57:47.755014 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:57:48.064557 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:57:49.459046 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:57:49.459131 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:57:49.459204 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:57:49.459268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:57:49.459328 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:57:49.459392 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:57:49.459455 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:57:49.769716 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:58:18.327035 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:58:18.327120 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:58:18.327190 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:58:18.327287 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:58:18.327350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:58:18.327410 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:58:18.327473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:58:18.632110 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:58:20.036678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:58:20.036772 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:58:20.036862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:58:20.036952 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:58:20.037029 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:58:20.037099 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:58:20.037167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:58:20.346881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:58:27.390478 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:58:27.390564 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:58:27.390626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:58:27.390698 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:58:27.390779 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:58:27.390879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:58:27.390947 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:58:27.694961 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:58:48.894361 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:58:48.894451 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:58:48.894513 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:58:48.894578 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:58:48.894645 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:58:48.894710 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:58:48.894779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:58:49.220076 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:58:50.606953 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:58:50.607040 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:58:50.607118 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:58:50.607193 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:58:50.607251 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:58:50.607316 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:58:50.607382 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:58:50.914371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:59:19.483999 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:59:19.484103 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:59:19.484195 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:59:19.484270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:59:19.484362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:59:19.484442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:59:19.484521 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:59:19.792060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:59:21.172711 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:59:21.172835 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:59:21.172912 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:59:21.172985 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:59:21.173059 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:59:21.173128 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:59:21.173204 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:59:21.485671 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:59:27.513625 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:59:27.513747 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:59:27.513837 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:59:27.513924 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:59:27.514000 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:59:27.514081 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:59:27.514156 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:59:27.822444 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:59:50.060799 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:59:50.060905 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:59:50.060977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:59:50.061056 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:59:50.061120 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:59:50.061191 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:59:50.061255 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:59:50.385328 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 05:59:51.745748 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 05:59:51.745836 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 05:59:51.745903 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 05:59:51.745966 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 05:59:51.746027 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 05:59:51.746086 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 05:59:51.746147 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 05:59:52.080060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:00:20.647494 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:00:20.647586 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:00:20.647656 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:00:20.647727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:00:20.647790 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:00:20.647855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:00:20.647928 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:00:20.955605 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:00:22.350909 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:00:22.350997 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:00:22.351057 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:00:22.351122 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:00:22.351183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:00:22.351243 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:00:22.351305 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:00:22.659056 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:00:27.631168 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:00:27.631277 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:00:27.631351 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:00:27.631430 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:00:27.631508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:00:27.631583 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:00:27.631658 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:00:27.939657 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:00:51.221143 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:00:51.221726 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:00:51.222520 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:00:51.222631 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:00:51.222715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:00:51.222809 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:00:51.222887 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:00:51.537352 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:00:52.915198 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:00:52.915300 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:00:52.915381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:00:52.915456 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:00:52.915524 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:00:52.915597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:00:52.915661 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:00:53.224187 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:01:21.813152 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:01:21.813252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:01:21.813334 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:01:21.813416 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:01:21.813504 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:01:21.813580 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:01:21.813668 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:01:22.126813 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:01:23.486261 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:01:23.486364 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:01:23.486433 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:01:23.486502 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:01:23.486563 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:01:23.486642 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:01:23.486710 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:01:23.796693 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:01:27.747970 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:01:27.748054 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:01:27.748125 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:01:27.748189 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:01:27.748252 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:01:27.748314 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:01:27.748378 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:01:28.056698 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:01:52.388206 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:01:52.388312 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:01:52.388375 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:01:52.388443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:01:52.388509 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:01:52.388575 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:01:52.388633 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:01:52.694068 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:01:54.069083 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:01:54.069165 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:01:54.069238 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:01:54.069303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:01:54.069378 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:01:54.069461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:01:54.069568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:01:54.377959 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:02:22.955149 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:02:22.955250 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:02:22.955331 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:02:22.955412 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:02:22.955490 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:02:22.955569 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:02:22.955643 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:02:23.262669 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:02:24.642950 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:02:24.643047 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:02:24.643128 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:02:24.643206 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:02:24.643283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:02:24.643354 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:02:24.643426 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:02:24.950934 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:02:27.868694 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:02:27.868802 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:02:27.868883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:02:27.868961 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:02:27.869047 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:02:27.869121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:02:27.869198 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:02:28.186006 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:02:53.525080 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:02:53.525203 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:02:53.525289 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:02:53.525371 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:02:53.525447 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:02:53.525529 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:02:53.525600 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:02:53.827438 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:02:55.220381 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:02:55.220478 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:02:55.220567 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:02:55.220643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:02:55.220726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:02:55.220805 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:02:55.220874 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:02:55.523659 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:03:24.100258 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:03:24.100358 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:03:24.100436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:03:24.100524 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:03:24.100594 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:03:24.100673 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:03:24.100775 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:03:24.411383 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:03:25.785684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:03:25.785788 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:03:25.785870 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:03:25.785943 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:03:25.786027 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:03:25.786100 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:03:25.786173 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:03:26.096524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:03:27.989026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:03:27.989140 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:03:27.989221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:03:27.989291 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:03:27.989371 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:03:27.989452 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:03:27.989529 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:03:28.289817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:03:54.673063 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:03:54.673175 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:03:54.673260 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:03:54.673344 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:03:54.673423 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:03:54.673492 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:03:54.673573 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:03:54.979900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:03:56.364483 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:03:56.364584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:03:56.364664 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:03:56.364766 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:03:56.364842 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:03:56.364921 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:03:56.364989 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:03:56.669532 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:04:25.246850 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:04:25.246953 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:04:25.247034 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:04:25.247122 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:04:25.247197 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:04:25.248317 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:04:25.248796 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:04:25.559547 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:04:26.931996 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:04:26.932089 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:04:26.932170 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:04:26.932232 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:04:26.932306 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:04:26.932373 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:04:26.932447 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:04:27.235587 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:04:28.106702 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:04:28.106788 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:04:28.106855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:04:28.106920 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:04:28.106992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:04:28.107055 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:04:28.107124 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:04:28.418030 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:04:55.824098 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:04:55.824183 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:04:55.824244 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:04:55.824309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:04:55.824378 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:04:55.824443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:04:55.824503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:04:56.133575 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:04:57.493838 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:04:57.493930 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:04:57.494009 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:04:57.494069 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:04:57.494133 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:04:57.494198 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:04:57.494258 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:04:57.799006 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:05:26.402610 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:05:26.402711 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:05:26.402800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:05:26.402858 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:05:26.402924 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:05:26.402989 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:05:26.403055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:05:26.706728 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:05:28.058993 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:05:28.059084 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:05:28.059161 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:05:28.059222 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:05:28.059295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:05:28.059361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:05:28.059427 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:05:28.365422 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:05:28.632174 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:05:28.632265 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:05:28.632333 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:05:28.632401 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:05:28.632469 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:05:28.632533 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:05:28.632593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:05:28.941448 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:05:56.978413 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:05:56.978513 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:05:56.978613 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:05:56.978721 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:05:56.978825 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:05:56.978933 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:05:56.979050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:05:57.285308 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:05:58.630834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:05:58.630977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:05:58.631059 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:05:58.631150 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:05:58.631237 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:05:58.631339 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:05:58.631416 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:05:58.935781 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:06:27.547898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:06:27.548026 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:06:27.548124 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:06:27.548211 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:06:27.548308 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:06:27.548381 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:06:27.548477 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:06:27.848940 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:06:28.351756 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:06:28.351857 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:06:28.351969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:06:28.352049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:06:28.352147 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:06:28.352229 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:06:28.352313 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:06:28.650862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:06:29.196510 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:06:29.196621 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:06:29.196726 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:06:29.196815 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:06:29.196916 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:06:29.197024 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:06:29.197976 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:06:29.514784 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:06:58.106610 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:06:58.106696 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:06:58.106778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:06:58.106857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:06:58.106925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:06:58.107000 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:06:58.107064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:06:58.416267 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:06:59.777620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:06:59.777716 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:06:59.777793 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:06:59.777865 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:06:59.777930 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:06:59.777998 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:06:59.778057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:07:00.097649 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:07:28.473502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:07:28.473579 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:07:28.473644 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:07:28.473707 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:07:28.473778 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:07:28.473843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:07:28.473915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:07:28.782232 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:07:29.050137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:07:29.050231 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:07:29.050306 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:07:29.050369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:07:29.050431 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:07:29.050486 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:07:29.050550 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:07:29.357837 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:07:30.365311 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:07:30.365410 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:07:30.365473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:07:30.365536 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:07:30.365611 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:07:30.365681 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:07:30.365751 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:07:30.677054 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:07:59.052853 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:07:59.052942 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:07:59.053014 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:07:59.053078 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:07:59.053144 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:07:59.053209 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:07:59.053271 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:07:59.367279 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:08:00.938690 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:08:00.938801 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:08:00.938871 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:08:00.938944 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:08:00.939011 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:08:00.939082 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:08:00.939150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:08:01.246045 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:08:28.591475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:08:28.591559 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:08:28.591629 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:08:28.591686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:08:28.591758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:08:28.591825 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:08:28.591893 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:08:28.897014 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:08:29.632765 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:08:29.632849 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:08:29.632919 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:08:29.632982 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:08:29.633050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:08:29.633111 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:08:29.633181 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:08:29.935759 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:08:31.507331 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:08:31.507415 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:08:31.507491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:08:31.507553 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:08:31.507623 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:08:31.507680 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:08:31.507747 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:08:31.815459 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:09:00.203260 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:09:00.203346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:09:00.203423 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:09:00.203496 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:09:00.203564 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:09:00.203632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:09:00.203702 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:09:00.514417 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:09:02.093263 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:09:02.093364 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:09:02.093436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:09:02.093502 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:09:02.093572 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:09:02.093638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:09:02.093707 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:09:02.402246 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:09:28.709509 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:09:28.709593 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:09:28.709666 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:09:28.709743 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:09:28.709816 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:09:28.709878 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:09:28.709965 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:09:29.024079 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:09:30.778611 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:09:30.778698 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:09:30.778788 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:09:30.778863 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:09:30.778929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:09:30.778992 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:09:30.779053 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:09:31.085849 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:09:32.659546 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:09:32.659633 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:09:32.659710 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:09:32.659779 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:09:32.659843 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:09:32.659903 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:09:32.659962 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:09:32.968509 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:10:01.348282 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:10:01.348391 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:10:01.348456 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:10:01.348517 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:10:01.348581 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:10:01.348644 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:10:01.348700 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:10:01.656609 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:10:03.234016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:10:03.234131 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:10:03.234197 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:10:03.234264 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:10:03.234332 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:10:03.234387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:10:03.234447 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:10:03.540997 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:10:28.831764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:10:28.831846 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:10:28.831916 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:10:28.831977 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:10:28.832039 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:10:28.832099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:10:28.832163 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:10:29.142325 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:10:31.922925 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:10:31.923022 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:10:31.923105 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:10:31.923179 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:10:31.923258 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:10:31.923331 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:10:31.923413 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:10:32.253250 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:10:33.800181 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:10:33.800291 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:10:33.800382 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:10:33.800460 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:10:33.800539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:10:33.800611 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:10:33.800684 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:10:34.099789 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:11:02.513786 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:11:02.513893 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:11:02.513968 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:11:02.514050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:11:02.514120 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:11:02.514193 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:11:02.514268 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:11:02.819383 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:11:04.357394 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:11:04.357475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:11:04.357536 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:11:04.357604 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:11:04.357671 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:11:04.357765 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:11:04.357862 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:11:04.657994 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:11:28.949730 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:11:28.949810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:11:28.949877 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:11:28.949942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:11:28.950009 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:11:28.950075 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:11:28.950137 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:11:29.258058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:11:33.073577 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:11:33.073659 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:11:33.073727 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:11:33.073800 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:11:33.073863 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:11:33.073928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:11:33.073997 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:11:33.369791 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:11:34.919166 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:11:34.919247 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:11:34.919307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:11:34.919375 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:11:34.919440 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:11:34.919520 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:11:34.919582 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:11:35.224632 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:12:03.626347 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:12:03.626441 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:12:03.626504 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:12:03.626574 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:12:03.626637 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:12:03.626701 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:12:03.626767 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:12:03.930916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:12:05.489419 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:12:05.489500 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:12:05.489584 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:12:05.489656 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:12:05.489728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:12:05.489791 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:12:05.489851 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:12:05.790186 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:12:29.062786 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:12:29.062865 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:12:29.062928 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:12:29.063002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:12:29.063061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:12:29.063127 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:12:29.063189 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:12:29.371403 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:12:34.195079 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:12:34.195167 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:12:34.195234 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:12:34.195301 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:12:34.195366 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:12:34.195427 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:12:34.195492 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:12:34.500797 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:12:36.050153 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:12:36.050245 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:12:36.050312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:12:36.050376 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:12:36.050441 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:12:36.050506 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:12:36.050563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:12:36.349856 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:13:04.762864 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:13:04.762977 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:13:04.763076 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:13:04.763158 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:13:04.763247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:13:04.763324 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:13:04.763407 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:13:05.076013 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:13:06.605496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:13:06.605590 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:13:06.605661 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:13:06.605741 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:13:06.605821 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:13:06.605899 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:13:06.605967 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:13:06.915272 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:13:29.180230 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:13:29.180344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:13:29.180426 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:13:29.180515 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:13:29.180595 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:13:29.180678 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:13:29.180760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:13:29.492490 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:13:35.339696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:13:35.339794 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:13:35.339875 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:13:35.339946 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:13:35.340019 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:13:35.340088 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:13:35.340148 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:13:35.648648 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:13:37.175314 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:13:37.175408 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:13:37.175482 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:13:37.175548 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:13:37.175617 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:13:37.175684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:13:37.175754 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:13:37.478105 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:14:05.915492 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:14:05.915609 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:14:05.915691 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:14:05.915774 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:14:05.915854 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:14:05.915933 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:14:05.916015 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:14:06.226641 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:14:07.739224 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:14:07.739336 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:14:07.739420 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:14:07.739494 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:14:07.739571 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:14:07.739639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:14:07.739709 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:14:08.044358 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:14:29.300481 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:14:29.300569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:14:29.300660 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:14:29.300769 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:14:29.300843 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:14:29.300912 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:14:29.300985 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:14:29.614033 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:14:36.483906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:14:36.483992 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:14:36.484062 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:14:36.484148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:14:36.484217 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:14:36.484289 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:14:36.484357 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:14:36.793450 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:14:38.304213 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:14:38.304295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:14:38.304362 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:14:38.304423 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:14:38.304485 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:14:38.304549 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:14:38.304607 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:14:38.615783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:15:07.064190 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:15:07.064303 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:15:07.064372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:15:07.064440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:15:07.064509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:15:07.064574 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:15:07.064636 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:15:07.389489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:15:08.873271 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:15:08.873372 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:15:08.873449 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:15:08.873515 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:15:08.873580 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:15:08.873645 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:15:08.873706 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:15:09.188524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:15:29.422137 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:15:29.422223 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:15:29.422294 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:15:29.422355 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:15:29.422422 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:15:29.422489 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:15:29.422558 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:15:29.726510 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:15:37.651101 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:15:37.651188 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:15:37.651265 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:15:37.651335 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:15:37.651394 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:15:37.651474 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:15:37.651558 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:15:37.958034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:15:39.456515 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:15:39.456630 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:15:39.456703 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:15:39.456776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:15:39.456842 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:15:39.456908 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:15:39.456973 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:15:39.760762 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:16:08.219875 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:16:08.219969 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:16:08.220034 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:16:08.220103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:16:08.220165 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:16:08.220233 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:16:08.220287 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:16:08.519274 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:16:10.022947 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:16:10.023050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:16:10.023115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:16:10.023182 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:16:10.023242 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:16:10.023308 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:16:10.023364 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:16:10.339854 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:16:29.545113 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:16:29.545204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:16:29.545287 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:16:29.545360 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:16:29.545433 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:16:29.545512 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:16:29.545589 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:16:29.854111 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:16:38.777416 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:16:38.777496 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:16:38.777580 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:16:38.777647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:16:38.777737 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:16:38.777803 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:16:38.777882 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:16:39.080817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:16:40.601516 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:16:40.601632 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:16:40.602702 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:16:40.603121 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:16:40.603552 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:16:40.604151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:16:40.605098 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:16:40.907137 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:17:09.340743 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:17:09.340828 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:17:09.340907 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:17:09.340973 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:17:09.341048 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:17:09.341109 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:17:09.341184 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:17:09.647164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:17:11.165666 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:17:11.165772 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:17:11.165840 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:17:11.165913 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:17:11.165972 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:17:11.166038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:17:11.166097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:17:11.471726 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:17:29.671381 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:17:29.671476 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:17:29.671557 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:17:29.671645 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:17:29.671731 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:17:29.671809 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:17:29.671906 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:17:29.978048 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:17:39.908448 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:17:39.908539 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:17:39.908613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:17:39.908689 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:17:39.908770 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:17:39.908844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:17:39.908918 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:17:40.228713 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:17:41.732964 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:17:41.733047 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:17:41.733126 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:17:41.733189 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:17:41.733257 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:17:41.733324 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:17:41.733389 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:17:42.072300 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:18:10.487811 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:18:10.487934 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:18:10.487999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:18:10.488063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:18:10.488137 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:18:10.488198 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:18:10.488268 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:18:10.797220 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:18:12.355957 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:18:12.356055 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:18:12.356145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:18:12.356222 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:18:12.356297 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:18:12.356370 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:18:12.356454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:18:12.659063 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:18:29.800276 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:18:29.800374 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:18:29.800449 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:18:29.800522 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:18:29.800593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:18:29.800669 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:18:29.800741 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:18:30.115206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:18:41.061391 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:18:41.061482 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:18:41.061544 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:18:41.061606 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:18:41.061669 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:18:41.061738 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:18:41.061797 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:18:41.366728 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:18:42.920147 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:18:42.920230 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:18:42.920309 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:18:42.920376 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:18:42.920438 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:18:42.920500 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:18:42.920559 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:18:43.229319 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:19:11.633511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:19:11.633591 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:19:11.633672 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:19:11.633750 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:19:11.633824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:19:11.633894 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:19:11.633960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:19:11.949957 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:19:13.495431 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:19:13.495522 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:19:13.495602 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:19:13.495683 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:19:13.495779 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:19:13.495852 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:19:13.495931 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:19:13.800843 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:19:29.927180 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:19:29.927276 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:19:29.927349 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:19:29.927419 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:19:29.927499 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:19:29.927565 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:19:29.927635 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:19:30.244384 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:19:42.224300 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:19:42.224383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:19:42.224452 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:19:42.224515 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:19:42.224576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:19:42.224637 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:19:42.224699 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:19:42.534628 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:19:44.070974 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:19:44.071059 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:19:44.071135 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:19:44.071199 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:19:44.071259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:19:44.071326 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:19:44.071386 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:19:44.386790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:20:12.796424 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:20:12.796552 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:20:12.796616 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:20:12.796681 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:20:12.796749 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:20:12.796813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:20:12.796876 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:20:13.113122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:20:14.659417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:20:14.659516 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:20:14.659581 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:20:14.659652 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:20:14.659710 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:20:14.659779 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:20:14.659842 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:20:14.973675 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:20:30.052218 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:20:30.052293 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:20:30.052363 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:20:30.052424 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:20:30.052484 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:20:30.052546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:20:30.052604 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:20:30.358030 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:20:43.373868 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:20:43.373953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:20:43.374019 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:20:43.374095 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:20:43.374159 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:20:43.374225 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:20:43.374290 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:20:43.680108 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:20:45.237329 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:20:45.237426 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:20:45.237489 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:20:45.237564 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:20:45.237624 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:20:45.237691 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:20:45.237756 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:20:45.538492 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:21:13.944809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:21:13.944900 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:21:13.944972 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:21:13.945042 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:21:13.945109 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:21:13.945171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:21:13.945236 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:21:14.255591 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:21:15.797514 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:21:15.797626 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:21:15.797689 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:21:15.797761 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:21:15.798703 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:21:15.799007 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:21:15.799344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:21:16.101862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:21:30.178375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:21:30.178480 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:21:30.178555 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:21:30.178638 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:21:30.178731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:21:30.178808 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:21:30.178886 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:21:30.486363 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:21:44.518251 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:21:44.518353 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:21:44.518440 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:21:44.518513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:21:44.518589 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:21:44.518669 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:21:44.518761 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:21:44.821530 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:21:46.362257 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:21:46.362381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:21:46.362459 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:21:46.362546 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:21:46.362627 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:21:46.362711 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:21:46.362795 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:21:46.665525 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:22:15.081589 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:22:15.081688 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:22:15.081764 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:22:15.081841 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:22:15.081906 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:22:15.081985 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:22:15.082069 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:22:15.390034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:22:16.922252 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:22:16.922352 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:22:16.922430 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:22:16.922522 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:22:16.922600 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:22:16.922677 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:22:16.922766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:22:17.227571 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:22:30.314424 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:22:30.314503 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:22:30.314578 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:22:30.314648 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:22:30.314715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:22:30.314787 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:22:30.314854 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:22:30.615911 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:22:45.648841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:22:45.648956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:22:45.649034 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:22:45.649114 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:22:45.649200 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:22:45.649272 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:22:45.649349 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:22:45.953041 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:22:47.489477 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:22:47.489586 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:22:47.489662 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:22:47.489760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:22:47.489840 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:22:47.489910 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:22:47.489983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:22:47.797033 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:23:16.212865 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:23:16.212974 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:23:16.213057 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:23:16.213138 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:23:16.213228 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:23:16.213298 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:23:16.213375 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:23:16.522760 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:23:18.061684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:23:18.061790 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:23:18.061862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:23:18.061932 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:23:18.062011 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:23:18.062088 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:23:18.062166 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:23:18.369352 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:23:30.439893 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:23:30.439974 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:23:30.440043 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:23:30.440122 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:23:30.440186 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:23:30.440254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:23:30.440318 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:23:30.749342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:23:46.782000 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:23:46.782084 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:23:46.782170 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:23:46.782238 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:23:46.782303 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:23:46.782367 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:23:46.782431 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:23:47.100632 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:23:48.632786 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:23:48.632895 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:23:48.632953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:23:48.633022 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:23:48.633082 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:23:48.633149 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:23:48.633213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:23:48.940025 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:24:17.360462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:24:17.360558 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:24:17.360622 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:24:17.360688 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:24:17.360761 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:24:17.360830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:24:17.360891 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:24:17.665184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:24:19.205709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:24:19.205797 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:24:19.205866 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:24:19.205934 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:24:19.206003 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:24:19.206064 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:24:19.206133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:24:19.517008 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:24:30.564823 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:24:30.564904 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:24:30.564972 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:24:30.565034 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:24:30.565098 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:24:30.565164 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:24:30.565228 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:24:30.875475 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:24:47.932101 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:24:47.932183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:24:47.932252 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:24:47.932323 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:24:47.932390 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:24:47.932450 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:24:47.932516 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:24:48.237003 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:24:49.773748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:24:49.773828 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:24:49.773886 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:24:49.773955 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:24:49.774024 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:24:49.774084 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:24:49.774140 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:24:50.095474 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:25:18.502901 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:25:18.502995 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:25:18.503056 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:25:18.503125 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:25:18.503184 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:25:18.503249 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:25:18.503307 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:25:18.810244 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:25:20.355271 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:25:20.355361 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:25:20.355442 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:25:20.355512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:25:20.355575 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:25:20.355636 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:25:20.355697 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:25:20.659725 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:25:30.692273 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:25:30.692356 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:25:30.692425 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:25:30.692487 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:25:30.692552 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:25:30.692619 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:25:30.692684 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:25:31.000042 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:25:49.070125 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:25:49.070214 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:25:49.070276 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:25:49.070343 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:25:49.070410 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:25:49.070486 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:25:49.070544 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:25:49.381371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:25:50.918802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:25:50.918885 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:25:50.918956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:25:50.919027 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:25:50.919090 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:25:50.919148 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:25:50.919213 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:25:51.222187 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:26:19.643723 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:26:19.643803 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:26:19.643872 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:26:19.643935 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:26:19.643996 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:26:19.644061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:26:19.644123 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:26:19.960498 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:26:21.480516 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:26:21.480597 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:26:21.480664 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:26:21.480735 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:26:21.480799 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:26:21.480858 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:26:21.480934 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:26:21.803354 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:26:30.820960 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:26:30.821060 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:26:30.821137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:26:30.821211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:26:30.821291 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:26:30.821362 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:26:30.821447 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:26:31.124360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:26:50.238999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:26:50.239090 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:26:50.239165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:26:50.239230 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:26:50.239302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:26:50.239375 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:26:50.239445 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:26:50.544372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:26:52.095111 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:26:52.095222 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:26:52.095295 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:26:52.095362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:26:52.095428 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:26:52.095504 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:26:52.095569 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:26:52.422346 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:27:20.808509 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:27:20.808595 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:27:20.808648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:27:20.808722 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:27:20.808785 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:27:20.808850 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:27:20.808911 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:27:21.110035 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:27:22.682551 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:27:22.682634 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:27:22.682701 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:27:22.682783 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:27:22.682847 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:27:22.682914 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:27:22.682974 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:27:22.986143 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:27:30.945147 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:27:30.945259 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:27:30.945328 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:27:30.945388 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:27:30.945458 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:27:30.945522 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:27:30.945583 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:27:31.252278 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:27:51.370273 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:27:51.370358 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:27:51.370426 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:27:51.370500 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:27:51.370566 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:27:51.370627 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:27:51.370693 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:27:51.679934 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:27:53.246099 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:27:53.246182 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:27:53.246250 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:27:53.246306 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:27:53.246373 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:27:53.246435 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:27:53.246502 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:27:53.559138 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:28:21.952624 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:28:21.952709 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:28:21.952792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:28:21.952860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:28:21.952927 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:28:21.952998 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:28:21.953063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:28:22.289575 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:28:23.818433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:28:23.818532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:28:23.818598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:28:23.818659 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:28:23.818729 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:28:23.818791 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:28:23.818855 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:28:24.130626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:28:31.069760 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:28:31.069844 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:28:31.069910 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:28:31.069976 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:28:31.070039 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:28:31.070093 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:28:31.070156 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:28:31.371786 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:28:52.552994 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:28:52.553079 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:28:52.553157 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:28:52.553223 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:28:52.553282 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:28:52.553344 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:28:52.553408 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:28:52.858024 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:28:54.401151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:28:54.401255 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:28:54.401323 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:28:54.401381 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:28:54.401444 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:28:54.401509 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:28:54.401572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:28:54.713517 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:29:23.125926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:29:23.126004 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:29:23.126073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:29:23.126140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:29:23.126201 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:29:23.126262 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:29:23.126325 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:29:23.438562 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:29:24.983651 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:29:24.983773 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:29:24.983872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:29:24.983968 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:29:24.984064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:29:24.984158 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:29:24.984252 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:29:25.311416 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:29:31.193062 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:29:31.193146 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:29:31.193222 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:29:31.193296 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:29:31.193366 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:29:31.193447 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:29:31.193506 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:29:31.506588 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:29:53.698157 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:29:53.698270 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:29:53.698338 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:29:53.698422 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:29:53.698500 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:29:53.698569 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:29:53.698634 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:29:54.001582 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:29:55.576860 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:29:55.576969 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:29:55.577055 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:29:55.577128 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:29:55.577206 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:29:55.577270 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:29:55.577339 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:29:55.882696 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:30:24.276823 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:30:24.276907 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:30:24.276993 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:30:24.277071 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:30:24.277153 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:30:24.277226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:30:24.277308 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:30:24.583042 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:30:26.145694 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:30:26.145810 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:30:26.145883 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:30:26.145953 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:30:26.146016 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:30:26.146069 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:30:26.146132 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:30:26.454074 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:30:31.318586 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:30:31.318677 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:30:31.318748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:30:31.318833 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:30:31.318901 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:30:31.318963 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:30:31.319025 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:30:31.636822 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:30:54.842437 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:30:54.842538 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:30:54.842613 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:30:54.842679 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:30:54.842757 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:30:54.842824 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:30:54.842891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:30:55.158734 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:30:56.715591 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:30:56.715673 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:30:56.715760 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:30:56.715825 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:30:56.715891 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:30:56.715948 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:30:56.716011 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:30:57.017329 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:31:25.422335 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:31:25.422443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:31:25.422507 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:31:25.422569 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:31:25.422634 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:31:25.422698 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:31:25.422767 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:31:25.730653 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:31:27.292289 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:31:27.292405 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:31:27.292465 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:31:27.292543 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:31:27.292602 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:31:27.292660 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:31:27.292737 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:31:27.603041 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:31:31.442510 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:31:31.442593 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:31:31.442671 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:31:31.442749 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:31:31.442847 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:31:31.442915 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:31:31.442984 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:31:31.749031 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:31:55.990522 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:31:55.990601 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:31:55.990662 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:31:55.990729 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:31:55.990792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:31:55.990863 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:31:55.990926 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:31:56.310916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:31:57.864441 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:31:57.864554 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:31:57.864638 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:31:57.864707 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:31:57.864788 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:31:57.864858 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:31:57.864928 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:31:58.175633 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:32:26.582336 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:32:26.582424 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:32:26.582496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:32:26.582561 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:32:26.582630 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:32:26.582688 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:32:26.582757 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:32:26.889364 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:32:28.434563 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:32:28.434658 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:32:28.434726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:32:28.434791 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:32:28.434867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:32:28.434929 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:32:28.434998 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:32:28.741675 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:32:31.567286 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:32:31.567371 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:32:31.567438 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:32:31.567507 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:32:31.567573 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:32:31.567636 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:32:31.567695 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:32:31.879743 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:32:57.154202 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:32:57.154289 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:32:57.154365 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:32:57.154428 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:32:57.154492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:32:57.154556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:32:57.154622 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:32:57.465069 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:32:59.019347 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:32:59.019454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:32:59.019518 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:32:59.019578 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:32:59.019636 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:32:59.019693 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:32:59.019765 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:32:59.332954 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:33:27.729027 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:33:27.729107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:33:27.729177 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:33:27.729238 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:33:27.729304 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:33:27.729364 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:33:27.729429 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:33:28.039787 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:33:29.595754 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:33:29.595854 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:33:29.595923 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:33:29.595988 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:33:29.596050 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:33:29.596114 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:33:29.596178 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:33:29.901319 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:33:31.693315 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:33:31.693435 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:33:31.693508 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:33:31.693595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:33:31.693658 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:33:31.693761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:33:31.693840 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:33:32.009442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:33:58.300345 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:33:58.300431 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:33:58.300509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:33:58.300577 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:33:58.300647 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:33:58.300714 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:33:58.300785 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:33:58.605394 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:34:00.172618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:34:00.172701 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:34:00.172773 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:34:00.172837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:34:00.172899 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:34:00.172959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:34:00.173018 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:34:00.479553 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:34:28.859668 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:34:28.859771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:34:28.859850 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:34:28.859923 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:34:28.859995 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:34:28.860066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:34:28.860133 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:34:29.180650 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:34:30.739578 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:34:30.739657 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:34:30.739724 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:34:30.739794 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:34:30.739854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:34:30.739929 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:34:30.739991 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:34:31.044159 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:34:31.812314 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:34:31.812412 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:34:31.812476 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:34:31.812536 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:34:31.812600 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:34:31.812666 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:34:31.812728 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:34:32.130553 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:34:59.446452 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:34:59.446529 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:34:59.446601 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:34:59.446662 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:34:59.446736 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:34:59.446803 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:34:59.446869 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:34:59.750707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:35:01.306462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:35:01.306536 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:35:01.306597 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:35:01.306660 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:35:01.306724 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:35:01.306803 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:35:01.306871 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:35:01.616845 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:35:30.008483 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:35:30.008573 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:35:30.008633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:35:30.008699 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:35:30.008770 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:35:30.008840 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:35:30.008901 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:35:30.326355 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:35:31.877479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:35:31.877569 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:35:31.877644 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:35:31.877728 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:35:31.877796 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:35:31.877865 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:35:31.877933 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:35:32.203151 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:35:32.468943 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:35:32.469028 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:35:32.469106 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:35:32.469178 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:35:32.469242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:35:32.469316 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:35:32.469374 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:35:32.769278 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:36:00.597707 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:36:00.597841 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:36:00.597932 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:36:00.598014 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:36:00.598099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:36:00.598185 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:36:00.598268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:36:00.899533 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:36:02.471443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:36:02.471552 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:36:02.471629 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:36:02.471702 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:36:02.471777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:36:02.471859 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:36:02.471952 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:36:02.774347 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:36:31.157705 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:36:31.157806 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:36:31.157874 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:36:31.157946 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:36:31.158010 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:36:31.158080 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:36:31.158150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:36:31.463231 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:36:32.073948 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:36:32.074060 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:36:32.074136 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:36:32.074208 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:36:32.074274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:36:32.074342 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:36:32.074411 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:36:32.388834 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:36:33.038383 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:36:33.038474 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:36:33.038551 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:36:33.038609 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:36:33.038669 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:36:33.038731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:36:33.038819 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:36:33.342802 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:37:01.725747 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:37:01.725831 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:37:01.725898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:37:01.725964 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:37:01.726023 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:37:01.726092 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:37:01.726151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:37:02.029909 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:37:03.608916 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:37:03.609036 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:37:03.609116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:37:03.609192 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:37:03.609270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:37:03.609355 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:37:03.609431 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:37:03.911451 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:37:32.208818 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:37:32.208911 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:37:32.208977 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:37:32.209040 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:37:32.209110 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:37:32.209174 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:37:32.209240 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:37:32.511426 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:37:32.770750 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:37:32.770837 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:37:32.770913 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:37:32.770978 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:37:32.771044 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:37:32.771108 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:37:32.771184 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:37:33.081741 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:37:34.169412 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:37:34.169503 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:37:34.169571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:37:34.169629 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:37:34.169695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:37:34.169760 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:37:34.169826 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:37:34.471338 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:38:02.772732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:38:02.772817 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:38:02.772881 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:38:02.772948 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:38:02.773010 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:38:02.773074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:38:02.773137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:38:03.085137 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:38:04.733620 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:38:04.733715 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:38:04.734701 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:38:04.734890 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:38:04.735063 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:38:04.735374 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:38:04.735546 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:38:05.046260 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:38:32.339949 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:38:32.340027 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:38:32.340093 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:38:32.340155 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:38:32.340223 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:38:32.340285 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:38:32.340356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:38:32.647736 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:38:33.344095 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:38:33.344173 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:38:33.344239 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:38:33.344299 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:38:33.344364 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:38:33.344428 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:38:33.344490 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:38:33.646977 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:38:35.310824 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:38:35.310913 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:38:35.310978 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:38:35.311039 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:38:35.311100 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:38:35.311162 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:38:35.311218 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:38:35.613488 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:39:03.906554 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:39:03.906641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:39:03.906726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:39:03.906803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:39:03.906866 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:39:03.906937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:39:03.906993 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:39:04.213605 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:39:05.872612 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:39:05.872693 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:39:05.872795 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:39:05.872860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:39:05.872925 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:39:05.872987 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:39:05.873053 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:39:06.179440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:39:32.469064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:39:32.469152 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:39:32.469238 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:39:32.469322 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:39:32.469387 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:39:32.469458 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:39:32.469531 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:39:32.775457 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:39:34.476810 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:39:34.476924 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:39:34.476987 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:39:34.477051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:39:34.477119 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:39:34.477180 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:39:34.477240 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:39:34.777895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:39:36.440005 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:39:36.440087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:39:36.440150 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:39:36.440211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:39:36.440273 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:39:36.440337 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:39:36.440397 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:39:36.738451 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:40:05.044034 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:40:05.044129 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:40:05.044192 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:40:05.044251 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:40:05.044320 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:40:05.044379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:40:05.044445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:40:05.358697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:40:07.002355 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:40:07.002464 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:40:07.002539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:40:07.002597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:40:07.002664 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:40:07.002727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:40:07.002792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:40:07.305934 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:40:32.596305 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:40:32.596386 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:40:32.596451 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:40:32.596525 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:40:32.596581 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:40:32.596646 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:40:32.596703 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:40:32.904677 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:40:35.618429 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:40:35.618516 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:40:35.618595 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:40:35.618659 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:40:35.618721 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:40:35.618788 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:40:35.618845 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:40:35.923365 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:40:37.566691 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:40:37.566791 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:40:37.566864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:40:37.566928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:40:37.566990 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:40:37.567051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:40:37.567119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:40:37.880328 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:41:06.192198 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:41:06.192282 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:41:06.192343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:41:06.192408 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:41:06.192475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:41:06.192536 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:41:06.192598 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:41:06.501830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:41:08.151357 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:41:08.151454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:41:08.151513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:41:08.151568 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:41:08.151628 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:41:08.151691 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:41:08.151761 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:41:08.454647 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:41:32.725582 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:41:32.725661 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:41:32.725731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:41:32.725796 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:41:32.725856 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:41:32.725916 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:41:32.725980 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:41:33.049113 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:41:36.760565 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:41:36.760649 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:41:36.760738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:41:36.760802 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:41:36.760873 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:41:36.760941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:41:36.761003 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:41:37.064987 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:41:38.711435 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:41:38.711522 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:41:38.711596 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:41:38.711675 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:41:38.711736 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:41:38.711798 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:41:38.711854 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:41:39.018304 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:42:07.323519 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:42:07.323612 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:42:07.323682 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:42:07.323762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:42:07.323832 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:42:07.323897 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:42:07.323960 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:42:07.631083 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:42:09.285390 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:42:09.285496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:42:09.285556 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:42:09.285623 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:42:09.285688 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:42:09.285758 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:42:09.285819 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:42:09.589959 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:42:32.856830 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:42:32.856911 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:42:32.856981 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:42:32.857042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:42:32.857107 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:42:32.857175 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:42:32.857238 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:42:33.167283 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:42:37.885733 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:42:37.885821 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:42:37.885904 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:42:37.885960 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:42:37.886029 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:42:37.886087 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:42:37.886151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:42:38.201826 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:42:39.856265 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:42:39.856345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:42:39.856421 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:42:39.856492 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:42:39.856555 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:42:39.856613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:42:39.856680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:42:40.178831 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:43:08.463715 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:43:08.463828 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:43:08.463893 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:43:08.463971 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:43:08.464036 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:43:08.464097 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:43:08.464161 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:43:08.770762 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:43:10.445904 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:43:10.446004 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:43:10.446071 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:43:10.446132 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:43:10.446197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:43:10.446259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:43:10.446320 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:43:10.745980 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:43:32.985765 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:43:32.985851 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:43:32.985918 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:43:32.985978 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:43:32.986037 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:43:32.986105 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:43:32.986170 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:43:33.296187 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:43:39.031665 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:43:39.031760 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:43:39.031836 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:43:39.031900 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:43:39.031959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:43:39.032021 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:43:39.032086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:43:39.341849 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:43:41.008071 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:43:41.008204 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:43:41.008290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:43:41.008400 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:43:41.008489 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:43:41.008577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:43:41.008670 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:43:41.315797 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:44:09.606979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:44:09.607066 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:44:09.607131 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:44:09.607192 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:44:09.607252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:44:09.607311 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:44:09.607372 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:44:09.916116 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:44:11.581231 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:44:11.581337 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:44:11.581411 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:44:11.581480 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:44:11.581547 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:44:11.581607 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:44:11.581669 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:44:11.896362 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:44:33.113302 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:44:33.113388 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:44:33.113457 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:44:33.113526 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:44:33.113601 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:44:33.113665 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:44:33.113742 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:44:33.418510 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:44:40.185288 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:44:40.185377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:44:40.185445 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:44:40.185509 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:44:40.185570 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:44:40.185633 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:44:40.185692 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:44:40.494564 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:44:42.178185 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:44:42.178287 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:44:42.178353 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:44:42.178424 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:44:42.178487 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:44:42.178556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:44:42.178625 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:44:42.483881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:45:10.759141 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:45:10.759235 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:45:10.759300 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:45:10.759371 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:45:10.759435 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:45:10.759499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:45:10.759558 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:45:11.064559 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:45:12.748582 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:45:12.748665 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:45:12.748742 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:45:12.748810 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:45:12.748874 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:45:12.748938 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:45:12.749002 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:45:13.056857 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:45:33.236515 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:45:33.236591 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:45:33.236668 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:45:33.236740 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:45:33.236805 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:45:33.236864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:45:33.236937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:45:33.545004 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:45:41.322996 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:45:41.323079 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:45:41.323143 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:45:41.323217 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:45:41.323284 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:45:41.323342 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:45:41.323403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:45:41.631510 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:45:43.315909 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:45:43.315995 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:45:43.316074 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:45:43.316137 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:45:43.316204 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:45:43.316263 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:45:43.316324 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:45:43.619831 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:46:11.897144 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:46:11.897235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:46:11.897305 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:46:11.897376 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:46:11.897442 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:46:11.898271 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:46:11.898461 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:46:12.232180 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:46:13.881111 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:46:13.881195 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:46:13.881264 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:46:13.881328 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:46:13.881393 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:46:13.881458 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:46:13.881526 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:46:14.212944 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:46:33.359812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:46:33.359890 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:46:33.359967 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:46:33.360031 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:46:33.360090 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:46:33.360152 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:46:33.360214 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:46:33.665743 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:46:42.498689 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:46:42.498780 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:46:42.498843 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:46:42.498924 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:46:42.498980 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:46:42.499049 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:46:42.499107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:46:42.800726 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:46:44.477833 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:46:44.477923 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:46:44.477996 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:46:44.478057 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:46:44.478118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:46:44.478186 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:46:44.478249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:46:44.783895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:47:13.066355 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:47:13.066440 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:47:13.066506 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:47:13.066570 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:47:13.066632 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:47:13.066703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:47:13.066770 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:47:13.367083 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:47:15.048484 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:47:15.048585 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:47:15.048652 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:47:15.048731 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:47:15.048798 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:47:15.048881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:47:15.048950 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:47:15.351688 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:47:33.484571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:47:33.484645 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:47:33.484710 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:47:33.484772 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:47:33.484835 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:47:33.484893 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:47:33.484955 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:47:33.792070 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:47:43.625588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:47:43.625672 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:47:43.625743 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:47:43.625809 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:47:43.625882 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:47:43.625944 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:47:43.626006 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:47:43.944702 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:47:45.613701 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:47:45.613804 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:47:45.613870 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:47:45.613931 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:47:45.614002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:47:45.614059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:47:45.614120 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:47:45.913651 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:48:14.209299 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:48:14.209401 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:48:14.209469 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:48:14.209535 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:48:14.209602 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:48:14.209664 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:48:14.209734 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:48:14.526324 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:48:16.173468 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:48:16.173558 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:48:16.173631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:48:16.173696 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:48:16.173783 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:48:16.173854 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:48:16.173918 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:48:16.475067 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:48:33.611199 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:48:33.611273 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:48:33.611341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:48:33.611403 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:48:33.611462 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:48:33.611524 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:48:33.611587 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:48:33.911372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:48:44.790112 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:48:44.790189 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:48:44.790253 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:48:44.790317 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:48:44.790380 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:48:44.790447 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:48:44.790508 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:48:45.101564 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:48:46.738696 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:48:46.738815 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:48:46.738895 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:48:46.738969 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:48:46.739043 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:48:46.739118 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:48:46.739195 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:48:47.044853 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:49:15.365741 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:49:15.365837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:49:15.365916 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:49:15.365976 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:49:15.366040 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:49:15.366108 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:49:15.366180 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:49:15.675035 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:49:17.306126 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:49:17.306211 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:49:17.306289 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:49:17.306352 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:49:17.306417 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:49:17.306473 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:49:17.306545 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:49:17.609431 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:49:33.735060 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:49:33.735151 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:49:33.735236 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:49:33.735322 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:49:33.735382 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:49:33.735439 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:49:33.735497 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:49:34.044373 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:49:45.935168 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:49:45.935271 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:49:45.935355 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:49:45.935433 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:49:45.935506 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:49:45.935593 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:49:45.935664 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:49:46.233094 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:49:47.881788 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:49:47.881902 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:49:47.881974 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:49:47.882052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:49:47.882128 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:49:47.882211 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:49:47.882281 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:49:48.181977 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:50:16.498490 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:50:16.498590 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:50:16.498665 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:50:16.498757 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:50:16.498829 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:50:16.498903 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:50:16.498977 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:50:16.801452 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:50:18.439963 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:50:18.440061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:50:18.440138 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:50:18.440214 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:50:18.440280 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:50:18.440346 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:50:18.440421 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:50:18.747263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:50:33.855591 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:50:33.855692 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:50:33.855785 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:50:33.855853 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:50:33.855932 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:50:33.856017 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:50:33.856096 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:50:34.155617 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:50:47.062059 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:50:47.062169 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:50:47.062242 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:50:47.062317 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:50:47.062389 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:50:47.062469 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:50:47.062550 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:50:47.369386 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:50:49.013581 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:50:49.013689 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:50:49.013765 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:50:49.013824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:50:49.013890 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:50:49.013954 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:50:49.014018 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:50:49.324687 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:51:17.635345 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:51:17.635461 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:51:17.635546 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:51:17.635626 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:51:17.635701 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:51:17.635794 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:51:17.635868 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:51:17.949902 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:51:19.587307 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:51:19.587418 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:51:19.587495 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:51:19.587574 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:51:19.587652 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:51:19.587736 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:51:19.587824 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:51:19.898180 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:51:33.977630 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:51:33.977729 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:51:33.977821 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:51:33.977900 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:51:33.977975 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:51:33.978055 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:51:33.978132 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:51:34.298123 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:51:48.218712 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:51:48.218813 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:51:48.218880 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:51:48.218954 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:51:48.219022 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:51:48.219103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:51:48.219168 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:51:48.524796 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:51:50.162453 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:51:50.162545 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:51:50.162606 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:51:50.162678 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:51:50.162747 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:51:50.162815 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:51:50.162879 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:51:50.465663 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:52:18.785936 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:52:18.786034 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:52:18.786095 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:52:18.786159 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:52:18.786226 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:52:18.786295 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:52:18.786371 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:52:19.089276 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:52:20.723031 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:52:20.723124 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:52:20.723194 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:52:20.723256 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:52:20.723317 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:52:20.723386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:52:20.723450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:52:21.024675 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:52:34.108849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:52:34.108963 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:52:34.109038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:52:34.109131 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:52:34.109208 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:52:34.109284 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:52:34.109354 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:52:34.429301 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:52:49.364144 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:52:49.364258 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:52:49.364345 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:52:49.364431 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:52:49.364512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:52:49.364587 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:52:49.364659 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:52:49.670120 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:52:51.286017 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:52:51.286109 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:52:51.286179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:52:51.286250 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:52:51.286321 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:52:51.286391 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:52:51.286454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:52:51.589347 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:53:19.936898 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:53:19.937000 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:53:19.937066 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:53:19.937128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:53:19.937199 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:53:19.937268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:53:19.937333 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:53:20.250626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:53:21.857341 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:53:21.857454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:53:21.857528 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:53:21.857597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:53:21.857666 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:53:21.857745 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:53:21.857823 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:53:22.170322 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:53:34.235873 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:53:34.235983 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:53:34.236075 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:53:34.236149 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:53:34.236221 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:53:34.236290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:53:34.236357 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:53:34.542902 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:53:50.513117 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:53:50.513211 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:53:50.513286 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:53:50.513351 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:53:50.513415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:53:50.513482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:53:50.513552 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:53:50.812772 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:53:52.432249 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:53:52.432340 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:53:52.432405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:53:52.432468 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:53:52.432528 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:53:52.432590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:53:52.432649 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:53:52.737979 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:54:21.071731 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:54:21.071817 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:54:21.071875 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:54:21.071936 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:54:21.071999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:54:21.072063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:54:21.072123 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:54:21.376253 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:54:23.000487 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:54:23.000579 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:54:23.000641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:54:23.000707 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:54:23.000781 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:54:23.000840 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:54:23.000907 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:54:23.312197 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:54:34.356701 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:54:34.356787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:54:34.356862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:54:34.356926 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:54:34.356987 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:54:34.357048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:54:34.357111 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:54:34.664159 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:54:51.636584 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:54:51.636705 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:54:51.636812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:54:51.636906 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:54:51.636985 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:54:51.637073 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:54:51.637150 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:54:51.944239 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:54:53.579151 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:54:53.579249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:54:53.579326 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:54:53.579395 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:54:53.579475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:54:53.579544 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:54:53.579614 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:54:53.885443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:55:22.212896 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:55:22.212979 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:55:22.213067 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:55:22.213133 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:55:22.213202 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:55:22.213264 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:55:22.213329 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:55:22.519636 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:55:24.155000 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:55:24.155083 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:55:24.155154 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:55:24.155218 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:55:24.155282 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:55:24.155343 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:55:24.155406 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:55:24.459367 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:55:34.476400 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:55:34.476480 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:55:34.476550 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:55:34.476610 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:55:34.476685 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:55:34.476754 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:55:34.476834 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:55:34.782524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:55:52.785346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:55:52.785464 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:55:52.785545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:55:52.785622 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:55:52.785723 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:55:52.785801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:55:52.785890 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:55:53.094370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:55:54.724344 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:55:54.724447 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:55:54.724534 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:55:54.724623 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:55:54.724700 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:55:54.724790 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:55:54.724863 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:55:55.029838 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:56:23.358067 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:56:23.358186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:56:23.358265 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:56:23.358345 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:56:23.358422 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:56:23.358501 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:56:23.358581 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:56:23.671393 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:56:25.298703 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:56:25.298793 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:56:25.298866 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:56:25.298952 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:56:25.299020 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:56:25.299083 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:56:25.299150 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:56:25.602638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:56:34.599465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:56:34.599539 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:56:34.599606 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:56:34.599674 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:56:34.599743 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:56:34.599810 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:56:34.599875 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:56:34.914066 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:56:53.939594 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:56:53.939680 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:56:53.939756 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:56:53.939820 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:56:53.939880 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:56:53.939947 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:56:53.940007 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:56:54.266037 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:56:55.861183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:56:55.861275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:56:55.861339 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:56:55.861397 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:56:55.861463 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:56:55.861526 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:56:55.861589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:56:56.164678 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:57:24.534413 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:57:24.534504 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:57:24.534572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:57:24.534636 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:57:24.534700 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:57:24.534771 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:57:24.534834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:57:24.852003 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:57:26.423798 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:57:26.423883 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:57:26.423944 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:57:26.424025 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:57:26.424083 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:57:26.424784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:57:26.425201 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:57:26.731334 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:57:34.722533 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:57:34.722619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:57:34.722686 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:57:34.722763 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:57:34.722830 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:57:34.722894 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:57:34.722955 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:57:35.033585 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:57:55.126592 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:57:55.126784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:57:55.126941 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:57:55.127066 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:57:55.127180 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:57:55.127313 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:57:55.127430 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:57:55.439978 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:57:57.000943 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:57:57.001029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:57:57.001114 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:57:57.001191 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:57:57.001273 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:57:57.001348 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:57:57.001423 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:57:57.312794 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:58:25.700079 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:58:25.700182 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:58:25.700278 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:58:25.700362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:58:25.700432 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:58:25.700507 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:58:25.700589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:58:26.008142 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:58:27.574154 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:58:27.574269 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:58:27.574345 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:58:27.574425 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:58:27.574491 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:58:27.574574 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:58:27.574643 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:58:27.880032 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:58:34.844203 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:58:34.844301 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:58:34.844415 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:58:34.844503 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:58:34.844611 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:58:34.844688 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:58:34.844778 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:58:35.153849 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:58:56.262734 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:58:56.262843 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:58:56.262917 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:58:56.262992 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:58:56.263072 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:58:56.263140 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:58:56.263209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:58:56.565387 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:58:58.139395 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:58:58.139483 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:58:58.139548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:58:58.139614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:58:58.139675 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:58:58.139759 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:58:58.139821 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:58:58.444130 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:59:26.819805 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:59:26.819898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:59:26.819966 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:59:26.820030 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:59:26.820096 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:59:26.820158 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:59:26.820221 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:59:27.128976 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:59:28.707850 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:59:28.707939 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:59:28.708001 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:59:28.708072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:59:28.708129 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:59:28.708199 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:59:28.708259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:59:29.020531 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:59:34.964213 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:59:34.964295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:59:34.964358 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:59:34.964425 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:59:34.964486 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:59:34.964551 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:59:34.964615 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:59:35.269823 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:59:57.391814 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:59:57.391900 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:59:57.391971 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:59:57.392037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:59:57.392104 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:59:57.392167 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:59:57.392229 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:59:57.695572 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 06:59:59.283857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 06:59:59.283975 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 06:59:59.284058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 06:59:59.284144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 06:59:59.284225 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 06:59:59.284308 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 06:59:59.284382 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 06:59:59.593947 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:00:27.952234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:00:27.952357 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:00:27.952436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:00:27.952519 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:00:27.952593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:00:27.952668 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:00:27.952749 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:00:28.265097 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:00:29.855550 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:00:29.855642 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:00:29.855712 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:00:29.855788 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:00:29.855863 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:00:29.855931 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:00:29.856002 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:00:30.165305 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:00:35.086853 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:00:35.086963 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:00:35.087047 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:00:35.087133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:00:35.087210 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:00:35.087282 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:00:35.087371 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:00:35.391674 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:00:58.529659 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:00:58.529769 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:00:58.529838 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:00:58.529909 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:00:58.529985 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:00:58.530064 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:00:58.531029 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:00:58.844240 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:01:00.431859 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:01:00.431961 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:01:00.432035 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:01:00.432103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:01:00.432167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:01:00.432234 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:01:00.432295 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:01:00.733790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:01:29.111096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:01:29.111182 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:01:29.111252 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:01:29.111331 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:01:29.111395 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:01:29.111462 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:01:29.111528 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:01:29.440478 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:01:30.994913 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:01:30.994994 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:01:30.995076 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:01:30.995138 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:01:30.995204 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:01:30.995268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:01:30.995334 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:01:31.307042 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:01:35.210587 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:01:35.210669 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:01:35.210744 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:01:35.210808 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:01:35.210867 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:01:35.210931 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:01:35.211004 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:01:35.517233 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:01:59.709795 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:01:59.709884 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:01:59.709960 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:01:59.710028 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:01:59.710093 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:01:59.710155 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:01:59.710229 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:02:00.015886 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:02:01.565399 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:02:01.565487 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:02:01.565551 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:02:01.565632 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:02:01.565692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:02:01.565760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:02:01.565823 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:02:01.881507 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:02:30.299240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:02:30.299342 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:02:30.299421 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:02:30.299501 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:02:30.299572 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:02:30.299655 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:02:30.299767 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:02:30.604548 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:02:32.160854 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:02:32.160955 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:02:32.161031 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:02:32.161106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:02:32.161171 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:02:32.161248 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:02:32.161316 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:02:32.471712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:02:35.333190 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:02:35.333276 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:02:35.333353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:02:35.333415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:02:35.333472 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:02:35.333542 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:02:35.333603 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:02:35.643500 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:03:00.859836 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:03:00.859923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:03:00.859997 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:03:00.860063 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:03:00.860123 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:03:00.860191 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:03:00.860256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:03:01.175865 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:03:02.735802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:03:02.735905 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:03:02.735964 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:03:02.736043 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:03:02.736111 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:03:02.736168 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:03:02.736227 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:03:03.040383 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:03:31.439425 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:03:31.439513 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:03:31.439593 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:03:31.439661 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:03:31.439735 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:03:31.439803 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:03:31.439870 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:03:31.741317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:03:33.303741 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:03:33.303835 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:03:33.303918 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:03:33.304000 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:03:33.304080 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:03:33.304165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:03:33.304242 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:03:33.610924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:03:35.474117 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:03:35.474208 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:03:35.474279 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:03:35.474365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:03:35.474436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:03:35.474512 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:03:35.474583 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:03:35.778218 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:04:02.005590 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:04:02.005679 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:04:02.005753 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:04:02.005824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:04:02.005888 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:04:02.005956 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:04:02.006021 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:04:02.325577 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:04:03.873738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:04:03.873841 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:04:03.873929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:04:03.874009 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:04:03.874092 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:04:03.874159 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:04:03.874219 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:04:04.187010 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:04:32.589087 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:04:32.589172 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:04:32.589239 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:04:32.589303 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:04:32.589368 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:04:32.589430 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:04:32.589495 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:04:32.893078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:04:34.454186 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:04:34.454274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:04:34.454361 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:04:34.454427 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:04:34.454497 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:04:34.454561 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:04:34.454621 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:04:34.757406 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:04:35.583800 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:04:35.583880 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:04:35.583950 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:04:35.584009 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:04:35.584070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:04:35.584131 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:04:35.584196 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:04:35.889567 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:05:03.154416 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:05:03.154529 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:05:03.154608 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:05:03.154670 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:05:03.154750 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:05:03.154808 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:05:03.154867 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:05:03.463371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:05:05.020893 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:05:05.020992 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:05:05.021070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:05:05.021151 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:05:05.021243 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:05:05.021331 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:05:05.021405 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:05:05.324613 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:05:33.730114 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:05:33.730209 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:05:33.730278 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:05:33.730346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:05:33.730414 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:05:33.730471 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:05:33.730537 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:05:34.038604 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:05:35.590577 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:05:35.590670 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:05:35.590778 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:05:35.590857 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:05:35.590944 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:05:35.591020 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:05:35.591090 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:05:35.909360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:05:36.170651 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:05:36.170739 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:05:36.170810 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:05:36.170867 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:05:36.170931 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:05:36.170990 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:05:36.171061 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:05:36.472688 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:06:04.305339 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:06:04.305434 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:06:04.305503 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:06:04.305562 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:06:04.305626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:06:04.305703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:06:04.305771 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:06:04.613176 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:06:06.171612 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:06:06.171703 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:06:06.171775 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:06:06.171853 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:06:06.171913 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:06:06.171978 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:06:06.172038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:06:06.476824 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:06:34.879870 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:06:34.879961 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:06:34.880034 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:06:34.880102 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:06:34.880163 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:06:34.880233 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:06:34.880293 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:06:35.188909 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:06:35.830579 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:06:35.830666 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:06:35.830745 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:06:35.830857 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:06:35.830969 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:06:35.831044 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:06:35.831116 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:06:36.132208 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:06:36.743299 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:06:36.743395 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:06:36.743476 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:06:36.743548 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:06:36.743630 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:06:36.743705 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:06:36.743787 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:06:37.042733 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:07:05.453684 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:07:05.453797 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:07:05.453869 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:07:05.453948 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:07:05.454014 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:07:05.454084 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:07:05.454154 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:07:05.761018 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:07:07.305194 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:07:07.305278 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:07:07.305354 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:07:07.305416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:07:07.305480 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:07:07.305542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:07:07.305610 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:07:07.616147 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:07:35.954345 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:07:35.954441 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:07:35.954527 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:07:35.954607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:07:35.954689 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:07:35.954780 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:07:35.954863 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:07:36.262373 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:07:36.524572 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:07:36.524654 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:07:36.524738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:07:36.524816 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:07:36.524901 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:07:36.524969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:07:36.525053 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:07:36.834203 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:07:37.884570 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:07:37.884678 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:07:37.884777 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:07:37.884868 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:07:37.884940 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:07:37.885012 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:07:37.885092 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:07:38.185418 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:08:06.525967 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:08:06.526050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:08:06.526120 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:08:06.526189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:08:06.526254 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:08:06.526322 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:08:06.526393 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:08:06.832040 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:08:08.447704 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:08:08.447800 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:08:08.447871 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:08:08.447937 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:08:08.448010 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:08:08.448074 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:08:08.448145 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:08:08.759060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:08:36.076915 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:08:36.077014 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:08:36.077092 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:08:36.077166 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:08:36.077237 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:08:36.077311 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:08:36.077379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:08:36.391230 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:08:37.097039 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:08:37.097154 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:08:37.097240 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:08:37.097324 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:08:37.097402 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:08:37.097476 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:08:37.097552 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:08:37.401021 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:08:39.021552 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:08:39.021660 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:08:39.021763 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:08:39.021847 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:08:39.021913 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:08:39.021985 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:08:39.022049 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:08:39.322706 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:09:07.659890 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:09:07.659976 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:09:07.660041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:09:07.660105 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:09:07.660171 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:09:07.660233 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:09:07.660289 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:09:07.967932 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:09:09.585593 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:09:09.585689 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:09:09.585792 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:09:09.585877 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:09:09.585954 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:09:09.586035 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:09:09.586110 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:09:09.883970 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:09:36.206238 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:09:36.206339 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:09:36.206404 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:09:36.206473 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:09:36.206553 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:09:36.206622 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:09:36.206688 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:09:36.512564 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:09:38.230119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:09:38.230199 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:09:38.230277 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:09:38.230339 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:09:38.230405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:09:38.230468 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:09:38.230531 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:09:38.537786 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:09:40.153548 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:09:40.153632 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:09:40.153700 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:09:40.153777 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:09:40.153844 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:09:40.153904 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:09:40.153966 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:09:40.461451 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:10:08.803367 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:10:08.803458 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:10:08.803572 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:10:08.803669 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:10:08.803757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:10:08.803846 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:10:08.803927 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:10:09.119310 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:10:10.723846 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:10:10.723952 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:10:10.724027 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:10:10.724101 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:10:10.724176 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:10:10.724258 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:10:10.724347 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:10:11.031567 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:10:36.334535 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:10:36.334628 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:10:36.334705 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:10:36.334804 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:10:36.334882 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:10:36.334957 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:10:36.335034 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:10:36.642790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:10:39.395949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:10:39.396042 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:10:39.396126 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:10:39.396210 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:10:39.396286 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:10:39.396371 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:10:39.396437 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:10:39.700222 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:10:41.293121 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:10:41.293241 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:10:41.293323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:10:41.293392 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:10:41.293474 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:10:41.293551 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:10:41.293630 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:10:41.597773 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:11:09.962903 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:11:09.962994 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:11:09.963072 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:11:09.963152 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:11:09.963226 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:11:09.963306 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:11:09.963377 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:11:10.272737 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:11:11.861777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:11:11.861886 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:11:11.861967 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:11:11.862043 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:11:11.862111 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:11:11.862185 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:11:11.862263 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:11:12.177020 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:11:36.458876 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:11:36.458974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:11:36.459044 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:11:36.459115 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:11:36.459190 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:11:36.459260 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:11:36.459323 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:11:36.766031 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:11:40.536035 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:11:40.536156 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:11:40.536240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:11:40.536314 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:11:40.536389 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:11:40.536465 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:11:40.536541 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:11:40.837333 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:11:42.445706 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:11:42.445812 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:11:42.445884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:11:42.445956 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:11:42.446029 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:11:42.446110 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:11:42.446177 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:11:42.753546 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:12:11.110966 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:12:11.111084 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:12:11.111169 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:12:11.111249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:12:11.111326 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:12:11.111404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:12:11.111479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:12:11.417822 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:12:13.011503 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:12:13.011591 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:12:13.011665 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:12:13.011741 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:12:13.011843 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:12:13.011911 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:12:13.011980 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:12:13.320890 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:12:36.580830 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:12:36.580921 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:12:36.581010 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:12:36.581089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:12:36.581167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:12:36.581246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:12:36.581320 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:12:36.886033 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:12:41.679983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:12:41.680080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:12:41.680161 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:12:41.680249 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:12:41.680333 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:12:41.680413 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:12:41.680492 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:12:41.987033 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:12:43.583942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:12:43.584053 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:12:43.584128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:12:43.584202 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:12:43.584280 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:12:43.584352 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:12:43.584429 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:12:43.895114 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:13:12.289161 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:13:12.289270 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:13:12.289337 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:13:12.289397 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:13:12.289458 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:13:12.289514 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:13:12.289578 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:13:12.588780 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:13:14.152530 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:13:14.152630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:13:14.152714 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:13:14.152794 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:13:14.152874 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:13:14.152954 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:13:14.153040 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:13:14.461872 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:13:36.703582 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:13:36.703672 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:13:36.703753 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:13:36.703828 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:13:36.703890 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:13:36.703967 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:13:36.704033 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:13:37.011965 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:13:42.853567 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:13:42.853641 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:13:42.853711 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:13:42.853782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:13:42.853852 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:13:42.853920 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:13:42.853991 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:13:43.158086 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:13:44.723723 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:13:44.723804 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:13:44.723871 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:13:44.723931 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:13:44.723995 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:13:44.724060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:13:44.724121 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:13:45.024636 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:14:13.414509 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:14:13.414594 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:14:13.414661 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:14:13.414736 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:14:13.414802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:14:13.414864 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:14:13.414924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:14:13.719475 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:14:15.283744 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:14:15.283841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:14:15.283908 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:14:15.283977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:14:15.284035 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:14:15.284095 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:14:15.284155 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:14:15.589765 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:14:36.835507 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:14:36.835635 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:14:36.835733 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:14:36.835812 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:14:36.835894 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:14:36.835984 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:14:36.836067 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:14:37.154243 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:14:43.988484 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:14:43.988587 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:14:43.988652 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:14:43.988726 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:14:43.988795 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:14:43.988858 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:14:43.988918 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:14:44.304767 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:14:45.852171 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:14:45.852274 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:14:45.852337 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:14:45.852406 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:14:45.852465 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:14:45.852528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:14:45.852587 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:14:46.165715 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:15:14.569240 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:15:14.569343 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:15:14.569433 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:15:14.569508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:15:14.569586 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:15:14.569664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:15:14.569747 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:15:14.875697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:15:16.428133 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:15:16.428242 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:15:16.428316 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:15:16.428387 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:15:16.428463 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:15:16.428530 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:15:16.428603 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:15:16.738580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:15:36.961230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:15:36.961319 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:15:36.961391 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:15:36.961467 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:15:36.961549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:15:36.961628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:15:36.961705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:15:37.271011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:15:45.139888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:15:45.140541 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:15:45.140633 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:15:45.140702 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:15:45.140775 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:15:45.140844 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:15:45.140908 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:15:45.448175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:15:47.007619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:15:47.007725 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:15:47.007795 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:15:47.007855 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:15:47.007919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:15:47.007982 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:15:47.008045 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:15:47.312712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:16:15.709252 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:16:15.709340 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:16:15.709420 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:16:15.709479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:16:15.709542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:16:15.709599 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:16:15.709668 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:16:16.020541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:16:17.572264 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:16:17.572351 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:16:17.572412 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:16:17.572482 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:16:17.572544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:16:17.572612 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:16:17.572669 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:16:17.891698 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:16:37.087241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:16:37.087338 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:16:37.087409 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:16:37.087492 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:16:37.087559 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:16:37.087632 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:16:37.087704 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:16:37.397897 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:16:46.278835 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:16:46.278917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:16:46.278980 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:16:46.279048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:16:46.279107 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:16:46.279187 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:16:46.279248 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:16:46.579568 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:16:48.156999 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:16:48.157083 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:16:48.157146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:16:48.157217 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:16:48.157273 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:16:48.157343 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:16:48.157399 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:16:48.459554 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:17:16.837114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:17:16.837226 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:17:16.837303 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:17:16.837378 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:17:16.837447 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:17:16.837512 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:17:16.837585 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:17:17.146884 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:17:18.722813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:17:18.722902 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:17:18.722971 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:17:18.723033 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:17:18.723105 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:17:18.723164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:17:18.723226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:17:19.028235 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:17:37.215593 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:17:37.215671 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:17:37.215742 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:17:37.215804 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:17:37.215869 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:17:37.215924 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:17:37.215995 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:17:37.519731 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:17:47.409116 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:17:47.409223 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:17:47.409302 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:17:47.409363 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:17:47.409421 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:17:47.409477 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:17:47.409542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:17:47.712604 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:17:49.297992 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:17:49.298090 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:17:49.298153 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:17:49.298219 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:17:49.298278 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:17:49.298356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:17:49.298418 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:17:49.604505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:18:17.976537 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:18:17.976619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:18:17.977438 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:18:17.977669 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:18:17.977824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:18:17.978149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:18:17.978675 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:18:18.291080 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:18:19.865212 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:18:19.865300 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:18:19.865365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:18:19.865429 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:18:19.865492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:18:19.865554 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:18:19.865620 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:18:20.191400 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:18:37.346925 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:18:37.347014 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:18:37.347087 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:18:37.347168 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:18:37.347246 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:18:37.347332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:18:37.347419 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:18:37.648822 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:18:48.547966 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:18:48.548053 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:18:48.548139 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:18:48.548213 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:18:48.548283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:18:48.548349 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:18:48.548431 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:18:48.856579 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:18:50.457162 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:18:50.457263 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:18:50.457337 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:18:50.457414 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:18:50.457480 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:18:50.457567 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:18:50.457668 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:18:50.763516 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:19:19.115150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:19:19.115258 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:19:19.115340 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:19:19.115420 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:19:19.115484 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:19:19.115566 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:19:19.115633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:19:19.430654 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:19:21.025253 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:19:21.025362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:19:21.025441 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:19:21.025545 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:19:21.025623 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:19:21.025704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:19:21.025784 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:19:21.338735 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:19:37.475153 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:19:37.475236 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:19:37.475308 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:19:37.475375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:19:37.475436 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:19:37.475514 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:19:37.475576 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:19:37.783132 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:19:49.693494 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:19:49.693583 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:19:49.693650 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:19:49.693724 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:19:49.693785 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:19:49.693848 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:19:49.693925 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:19:50.014170 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:19:51.609393 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:19:51.609476 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:19:51.609542 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:19:51.609607 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:19:51.609672 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:19:51.609746 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:19:51.609812 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:19:51.932583 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:20:20.298776 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:20:20.298866 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:20:20.298934 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:20:20.299033 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:20:20.299094 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:20:20.299165 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:20:20.299228 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:20:20.601664 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:20:22.214296 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:20:22.214381 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:20:22.214456 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:20:22.214517 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:20:22.214614 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:20:22.214691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:20:22.214767 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:20:22.526363 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:20:37.603383 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:20:37.603484 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:20:37.603550 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:20:37.603615 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:20:37.603679 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:20:37.603756 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:20:37.603816 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:20:37.912128 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:20:50.860384 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:20:50.860482 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:20:50.860553 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:20:50.860616 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:20:50.860679 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:20:50.860752 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:20:50.860816 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:20:51.169449 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:20:52.794263 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:20:52.794353 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:20:52.794442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:20:52.794507 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:20:52.794569 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:20:52.794630 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:20:52.794702 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:20:53.103615 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:21:21.432094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:21:21.432181 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:21:21.432241 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:21:21.432304 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:21:21.432368 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:21:21.432436 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:21:21.432503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:21:21.736067 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:21:23.373062 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:21:23.373148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:21:23.373232 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:21:23.373299 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:21:23.373366 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:21:23.373431 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:21:23.373495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:21:23.684206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:21:37.727819 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:21:37.727900 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:21:37.727969 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:21:37.728032 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:21:37.728088 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:21:37.728157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:21:37.728224 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:21:38.036748 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:21:52.000817 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:21:52.000911 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:21:52.000973 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:21:52.001031 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:21:52.001094 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:21:52.001154 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:21:52.001214 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:21:52.335195 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:21:53.951687 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:21:53.951783 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:21:53.951849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:21:53.951914 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:21:53.951980 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:21:53.952049 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:21:53.952121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:21:54.264550 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:22:22.597450 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:22:22.597534 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:22:22.597610 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:22:22.597675 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:22:22.597740 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:22:22.597800 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:22:22.597870 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:22:22.909921 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:22:24.525167 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:22:24.525261 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:22:24.525346 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:22:24.525421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:22:24.525502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:22:24.525576 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:22:24.525667 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:22:24.836171 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:22:37.861704 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:22:37.861821 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:22:37.861912 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:22:37.861999 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:22:37.862122 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:22:37.862196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:22:37.862273 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:22:38.163712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:22:53.183319 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:22:53.183403 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:22:53.183480 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:22:53.183549 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:22:53.183617 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:22:53.183682 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:22:53.183762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:22:53.489870 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:22:55.103980 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:22:55.104067 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:22:55.104135 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:22:55.104202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:22:55.104272 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:22:55.104336 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:22:55.104396 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:22:55.410436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:23:23.749818 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:23:23.749905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:23:23.749982 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:23:23.750050 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:23:23.750111 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:23:23.750170 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:23:23.750237 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:23:24.056988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:23:25.673472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:23:25.673553 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:23:25.673638 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:23:25.673702 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:23:25.673765 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:23:25.673832 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:23:25.673896 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:23:25.976366 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:23:37.991231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:23:37.991306 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:23:37.991365 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:23:37.991425 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:23:37.991487 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:23:37.991545 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:23:37.991603 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:23:38.294227 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:23:54.324195 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:23:54.324288 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:23:54.324352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:23:54.324421 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:23:54.324485 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:23:54.324554 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:23:54.324617 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:23:54.631661 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:23:56.240557 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:23:56.240639 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:23:56.240699 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:23:56.240774 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:23:56.240842 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:23:56.240912 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:23:56.240970 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:23:56.548020 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:24:24.894545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:24:24.894624 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:24:24.894692 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:24:24.894762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:24:24.894826 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:24:24.894889 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:24:24.894955 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:24:25.207466 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:24:26.807768 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:24:26.807881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:24:26.807983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:24:26.808062 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:24:26.808141 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:24:26.808212 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:24:26.808287 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:24:27.116978 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:24:38.121489 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:24:38.121571 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:24:38.121641 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:24:38.121705 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:24:38.121778 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:24:38.121839 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:24:38.121903 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:24:38.427031 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:24:55.481939 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:24:55.482028 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:24:55.482099 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:24:55.482164 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:24:55.482223 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:24:55.482284 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:24:55.483425 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:24:55.787797 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:24:57.383183 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:24:57.383261 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:24:57.383331 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:24:57.383404 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:24:57.383466 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:24:57.383528 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:24:57.383594 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:24:57.687705 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:25:26.049868 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:25:26.049966 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:25:26.050034 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:25:26.050091 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:25:26.050151 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:25:26.050214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:25:26.050277 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:25:26.371752 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:25:27.952548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:25:27.952651 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:25:27.952731 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:25:27.952813 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:25:27.952878 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:25:27.952951 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:25:27.953019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:25:28.256638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:25:38.252103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:25:38.252178 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:25:38.252255 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:25:38.252320 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:25:38.252378 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:25:38.252438 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:25:38.252499 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:25:38.556192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:25:56.648895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:25:56.648976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:25:56.649051 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:25:56.649112 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:25:56.649180 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:25:56.649240 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:25:56.649300 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:25:56.958217 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:25:58.515981 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:25:58.516086 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:25:58.516176 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:25:58.516259 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:25:58.516345 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:25:58.516416 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:25:58.516503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:25:58.822940 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:26:27.230118 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:26:27.230245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:26:27.230310 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:26:27.230372 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:26:27.230442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:26:27.230507 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:26:27.230568 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:26:27.529107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:26:29.089796 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:26:29.089897 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:26:29.089978 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:26:29.090044 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:26:29.090116 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:26:29.090180 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:26:29.090252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:26:29.410905 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:26:38.382760 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:26:38.382837 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:26:38.382910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:26:38.382976 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:26:38.383042 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:26:38.383101 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:26:38.383164 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:26:38.688828 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:26:57.786210 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:26:57.786321 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:26:57.786388 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:26:57.786451 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:26:57.786510 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:26:57.786576 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:26:57.786640 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:26:58.088873 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:26:59.670108 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:26:59.670191 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:26:59.670265 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:26:59.670328 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:26:59.670390 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:26:59.670450 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:26:59.670518 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:26:59.974396 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:27:28.345205 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:27:28.345303 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:27:28.345379 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:27:28.345459 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:27:28.345542 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:27:28.345636 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:27:28.345709 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:27:28.654628 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:27:30.258572 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:27:30.258670 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:27:30.258762 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:27:30.258857 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:27:30.258951 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:27:30.259028 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:27:30.259101 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:27:30.567787 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:27:38.507645 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:27:38.507734 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:27:38.507810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:27:38.507887 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:27:38.507955 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:27:38.508027 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:27:38.508100 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:27:38.815484 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:27:58.942826 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:27:58.942945 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:27:58.943040 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:27:58.943137 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:27:58.943208 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:27:58.943288 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:27:58.943372 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:27:59.251428 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:28:00.821416 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:28:00.821522 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:28:00.821587 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:28:00.821665 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:28:00.821744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:28:00.821816 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:28:00.821891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:28:01.127683 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:28:29.512568 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:28:29.512660 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:28:29.512732 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:28:29.512791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:28:29.512875 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:28:29.512965 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:28:29.513027 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:28:29.817591 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:28:31.389070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:28:31.389162 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:28:31.389245 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:28:31.389313 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:28:31.389379 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:28:31.389444 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:28:31.389508 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:28:31.698398 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:28:38.642176 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:28:38.642277 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:28:38.642362 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:28:38.642430 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:28:38.642508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:28:38.642582 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:28:38.642671 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:28:38.948190 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:29:00.084073 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:29:00.084180 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:29:00.084270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:29:00.084348 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:29:00.084432 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:29:00.084511 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:29:00.084579 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:29:00.394187 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:29:01.961019 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:29:01.961097 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:29:01.961163 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:29:01.961223 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:29:01.961294 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:29:01.961356 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:29:01.961425 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:29:02.281928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:29:30.661650 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:29:30.661749 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:29:30.661822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:29:30.661891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:29:30.661958 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:29:30.662024 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:29:30.662085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:29:30.966834 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:29:32.538342 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:29:32.538421 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:29:32.538496 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:29:32.538564 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:29:32.538630 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:29:32.538695 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:29:32.538772 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:29:32.847129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:29:38.767151 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:29:38.767229 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:29:38.767293 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:29:38.767354 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:29:38.767421 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:29:38.767485 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:29:38.767551 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:29:39.069618 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:30:01.228445 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:30:01.228526 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:30:01.228603 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:30:01.228667 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:30:01.228757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:30:01.228824 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:30:01.228884 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:30:01.532114 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:30:03.113183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:30:03.113276 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:30:03.113341 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:30:03.113413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:30:03.113475 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:30:03.113540 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:30:03.113605 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:30:03.415781 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:30:31.788626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:30:31.788747 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:30:31.788817 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:30:31.788890 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:30:31.788959 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:30:31.789021 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:30:31.789082 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:30:32.114255 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:30:33.676015 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:30:33.676430 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:30:33.677011 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:30:33.677551 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:30:33.678533 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:30:33.678628 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:30:33.678710 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:30:33.985526 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:30:38.892592 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:30:38.892697 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:30:38.892767 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:30:38.892847 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:30:38.892914 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:30:38.892979 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:30:38.893049 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:30:39.210138 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:31:02.380518 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:31:02.380629 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:31:02.380731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:31:02.380806 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:31:02.380891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:31:02.380967 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:31:02.381058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:31:02.690371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:31:04.250319 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:31:04.250422 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:31:04.250505 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:31:04.250591 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:31:04.250668 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:31:04.250751 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:31:04.250830 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:31:04.552458 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:31:32.953583 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:31:32.953699 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:31:32.953778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:31:32.953861 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:31:32.953933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:31:32.954007 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:31:32.954079 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:31:33.264928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:31:34.816865 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:31:34.816959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:31:34.817023 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:31:34.817091 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:31:34.817162 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:31:34.817232 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:31:34.817304 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:31:35.121860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:31:39.022007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:31:39.022094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:31:39.022184 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:31:39.022255 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:31:39.022330 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:31:39.022413 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:31:39.022485 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:31:39.332928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:32:03.530774 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:32:03.530863 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:32:03.530934 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:32:03.531010 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:32:03.531080 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:32:03.531147 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:32:03.531209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:32:03.838003 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:32:05.384841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:32:05.384947 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:32:05.385033 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:32:05.385106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:32:05.385171 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:32:05.385238 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:32:05.385301 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:32:05.687508 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:32:34.102001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:32:34.102093 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:32:34.102168 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:32:34.102228 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:32:34.102291 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:32:34.102355 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:32:34.102417 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:32:34.409267 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:32:35.940891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:32:35.940974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:32:35.941037 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:32:35.941104 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:32:35.941161 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:32:35.941225 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:32:35.941282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:32:36.252779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:32:39.150465 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:32:39.150562 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:32:39.150646 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:32:39.150733 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:32:39.150803 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:32:39.150877 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:32:39.150946 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:32:39.457614 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:33:04.667446 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:33:04.667521 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:33:04.667607 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:33:04.667668 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:33:04.667741 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:33:04.667801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:33:04.668628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:33:04.975754 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:33:06.515865 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:33:06.515957 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:33:06.516037 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:33:06.516121 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:33:06.516205 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:33:06.516284 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:33:06.516364 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:33:06.816183 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:33:35.243147 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:33:35.243237 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:33:35.243307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:33:35.243381 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:33:35.243452 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:33:35.243522 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:33:35.243592 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:33:35.547767 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:33:37.077252 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:33:37.077330 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:33:37.077397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:33:37.077455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:33:37.077519 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:33:37.077581 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:33:37.077646 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:33:37.379107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:33:39.279404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:33:39.279493 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:33:39.279569 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:33:39.279647 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:33:39.279730 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:33:39.279806 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:33:39.279885 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:33:39.591791 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:34:05.809300 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:34:05.809414 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:34:05.809488 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:34:05.809556 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:34:05.809622 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:34:05.809692 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:34:05.809770 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:34:06.118596 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:34:07.644388 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:34:07.644499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:34:07.644576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:34:07.644643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:34:07.644746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:34:07.644815 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:34:07.644883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:34:07.945076 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:34:36.380932 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:34:36.381013 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:34:36.381082 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:34:36.381148 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:34:36.381214 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:34:36.381277 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:34:36.381343 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:34:36.687154 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:34:38.208055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:34:38.208142 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:34:38.208214 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:34:38.208287 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:34:38.208351 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:34:38.208410 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:34:38.208473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:34:38.512411 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:34:39.404475 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:34:39.404554 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:34:39.404617 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:34:39.404682 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:34:39.404749 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:34:39.404812 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:34:39.404878 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:34:39.716327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:35:06.951187 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:35:06.951276 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:35:06.951340 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:35:06.951409 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:35:06.951475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:35:06.951538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:35:06.951606 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:35:07.259091 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:35:08.774029 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:35:08.774147 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:35:08.774246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:35:08.774309 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:35:08.774378 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:35:08.774446 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:35:08.774519 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:35:09.075039 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:35:37.517109 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:35:37.517199 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:35:37.517266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:35:37.517331 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:35:37.517394 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:35:37.517463 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:35:37.517527 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:35:37.820896 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:35:39.342558 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:35:39.342636 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:35:39.342700 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:35:39.342776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:35:39.342844 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:35:39.342903 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:35:39.342963 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:35:39.652513 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:35:39.911125 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:35:39.911210 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:35:39.911270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:35:39.911333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:35:39.911396 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:35:39.911454 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:35:39.911523 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:35:40.222793 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:36:08.081427 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:36:08.081534 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:36:08.081602 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:36:08.081668 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:36:08.081740 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:36:08.081802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:36:08.081863 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:36:08.392185 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:36:09.912950 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:36:09.913029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:36:09.913092 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:36:09.913161 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:36:09.913227 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:36:09.913292 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:36:09.913353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:36:10.218358 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:36:38.655089 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:36:38.655189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:36:38.655252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:36:38.655321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:36:38.655383 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:36:38.655442 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:36:38.655501 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:36:38.963057 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:36:39.651078 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:36:39.651155 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:36:39.651225 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:36:39.651291 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:36:39.651369 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:36:39.651428 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:36:39.651494 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:36:39.960175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:36:40.481252 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:36:40.481338 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:36:40.481402 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:36:40.481479 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:36:40.481543 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:36:40.481610 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:36:40.481669 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:36:40.788114 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:37:09.249330 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:37:09.249438 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:37:09.249519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:37:09.249598 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:37:09.249676 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:37:09.249785 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:37:09.249857 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:37:09.560714 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:37:11.051349 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:37:11.051443 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:37:11.051538 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:37:11.051620 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:37:11.051708 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:37:11.051792 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:37:11.051877 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:37:11.358650 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:37:39.786642 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:37:39.786761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:37:39.786845 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:37:39.786947 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:37:39.787023 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:37:39.787110 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:37:39.787196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:37:40.096559 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:37:40.362911 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:37:40.363000 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:37:40.363066 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:37:40.363137 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:37:40.363209 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:37:40.363276 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:37:40.363339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:37:40.667032 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:37:41.619651 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:37:41.619738 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:37:41.619818 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:37:41.619879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:37:41.619944 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:37:41.620012 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:37:41.620078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:37:41.921827 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:38:10.365346 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:38:10.365446 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:38:10.365519 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:38:10.365582 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:38:10.365644 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:38:10.365708 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:38:10.365776 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:38:10.672955 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:38:12.195805 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:38:12.195921 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:38:12.195998 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:38:12.196066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:38:12.196138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:38:12.196201 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:38:12.196271 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:38:12.498124 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:38:39.910906 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:38:39.910992 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:38:39.911064 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:38:39.911138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:38:39.911203 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:38:39.911262 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:38:39.911321 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:38:40.235115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:38:40.931668 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:38:40.931768 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:38:40.931840 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:38:40.931917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:38:40.933014 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:38:40.933818 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:38:40.934432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:38:41.243783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:38:42.755994 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:38:42.756096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:38:42.756190 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:38:42.756339 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:38:42.756477 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:38:42.756608 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:38:42.756766 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:38:43.065270 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:39:11.505294 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:39:11.505405 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:39:11.505482 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:39:11.505572 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:39:11.505647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:39:11.505729 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:39:11.505806 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:39:11.819320 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:39:13.320772 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:39:13.320857 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:39:13.320942 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:39:13.321017 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:39:13.321092 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:39:13.321167 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:39:13.321232 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:39:13.625738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:39:40.037821 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:39:40.037915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:39:40.037982 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:39:40.038051 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:39:40.038116 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:39:40.038183 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:39:40.038239 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:39:40.358137 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:39:42.095367 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:39:42.095472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:39:42.095550 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:39:42.095620 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:39:42.095700 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:39:42.095775 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:39:42.095849 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:39:42.405473 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:39:43.888197 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:39:43.889159 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:39:43.889283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:39:43.889356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:39:43.889424 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:39:43.889496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:39:43.889595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:39:44.192792 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:40:12.676904 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:40:12.676992 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:40:12.677059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:40:12.677130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:40:12.677192 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:40:12.677258 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:40:12.677323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:40:12.979322 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:40:14.450483 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:40:14.450571 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:40:14.450636 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:40:14.450712 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:40:14.450787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:40:14.450852 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:40:14.450914 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:40:14.755358 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:40:40.165643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:40:40.165743 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:40:40.165810 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:40:40.165871 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:40:40.165932 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:40:40.165991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:40:40.166054 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:40:40.469352 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:40:43.249074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:40:43.249159 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:40:43.249234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:40:43.249304 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:40:43.249365 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:40:43.249430 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:40:43.249492 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:40:43.551625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:40:45.015600 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:40:45.015674 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:40:45.015746 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:40:45.015812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:40:45.015878 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:40:45.015940 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:40:45.016006 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:40:45.328343 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:41:13.810157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:41:13.810256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:41:13.810346 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:41:13.810430 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:41:13.810505 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:41:13.810627 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:41:13.810708 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:41:14.118190 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:41:15.592472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:41:15.592572 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:41:15.592656 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:41:15.592740 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:41:15.592819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:41:15.592894 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:41:15.592976 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:41:15.892488 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:41:40.297379 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:41:40.297471 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:41:40.297555 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:41:40.297630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:41:40.297723 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:41:40.297808 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:41:40.297891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:41:40.596081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:41:44.395958 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:41:44.396056 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:41:44.396128 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:41:44.396205 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:41:44.396273 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:41:44.396344 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:41:44.396412 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:41:44.703482 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:41:46.161713 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:41:46.161819 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:41:46.161889 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:41:46.161956 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:41:46.162020 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:41:46.162088 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:41:46.162168 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:41:46.463859 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:42:14.965037 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:42:14.965134 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:42:14.965200 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:42:14.965264 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:42:14.965330 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:42:14.965389 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:42:14.965465 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:42:15.274979 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:42:16.729530 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:42:16.729615 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:42:16.729672 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:42:16.729748 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:42:16.729803 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:42:16.729877 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:42:16.729937 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:42:17.028901 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:42:40.430874 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:42:40.430970 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:42:40.431049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:42:40.431130 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:42:40.431204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:42:40.431289 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:42:40.431367 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:42:40.732386 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:42:45.558501 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:42:45.558620 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:42:45.558724 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:42:45.558816 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:42:45.558895 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:42:45.558969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:42:45.559045 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:42:45.861978 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:42:47.294135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:42:47.294222 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:42:47.294293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:42:47.294362 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:42:47.294436 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:42:47.294501 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:42:47.294583 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:42:47.591666 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:43:16.120102 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:43:16.120187 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:43:16.120252 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:43:16.120311 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:43:16.120374 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:43:16.120434 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:43:16.120502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:43:16.431059 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:43:17.856633 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:43:17.856761 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:43:17.856828 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:43:17.856901 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:43:17.856961 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:43:17.857028 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:43:17.857089 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:43:18.163467 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:43:24.845047 I | op-k8sutil: ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS="15" (default) >2022-11-24 07:43:24.845091 I | op-k8sutil: ROOK_LOG_LEVEL="INFO" (env var) >2022-11-24 07:43:24.845100 I | op-k8sutil: ROOK_ENABLE_DISCOVERY_DAEMON="false" (env var) >2022-11-24 07:43:24.848734 I | operator: rook-ceph-operator-config-controller done reconciling >2022-11-24 07:43:40.558239 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:43:40.558322 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:43:40.558391 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:43:40.558462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:43:40.558531 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:43:40.558597 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:43:40.558660 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:43:40.866813 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:43:46.702740 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:43:46.702822 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:43:46.702902 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:43:46.702961 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:43:46.703022 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:43:46.703085 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:43:46.703144 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:43:47.013382 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:43:48.429145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:43:48.429244 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:43:48.429320 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:43:48.429378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:43:48.429446 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:43:48.429514 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:43:48.429578 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:43:48.733776 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:44:17.272621 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:44:17.272730 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:44:17.272796 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:44:17.272869 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:44:17.272940 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:44:17.273007 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:44:17.273070 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:44:17.580845 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:44:18.993550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:44:18.993633 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:44:18.993695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:44:18.993775 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:44:18.993837 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:44:18.993902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:44:18.993962 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:44:19.305872 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:44:40.679395 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:44:40.679489 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:44:40.679558 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:44:40.679625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:44:40.679715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:44:40.679786 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:44:40.679860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:44:40.987707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:44:47.855183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:44:47.855266 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:44:47.855332 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:44:47.855403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:44:47.855469 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:44:47.855528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:44:47.855588 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:44:48.158070 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:44:49.563644 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:44:49.563736 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:44:49.563816 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:44:49.563879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:44:49.563940 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:44:49.563998 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:44:49.564066 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:44:49.877424 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:45:18.421137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:45:18.421205 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:45:18.421275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:45:18.421337 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:45:18.421399 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:45:18.421457 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:45:18.421519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:45:18.731190 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:45:20.140004 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:45:20.140103 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:45:20.140174 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:45:20.140238 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:45:20.140312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:45:20.140370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:45:20.140443 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:45:20.445622 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:45:40.805455 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:45:40.805536 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:45:40.805637 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:45:40.805712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:45:40.805789 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:45:40.805853 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:45:40.805925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:45:41.107303 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:45:48.987826 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:45:48.987904 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:45:48.987970 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:45:48.988036 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:45:48.988098 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:45:48.988160 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:45:48.988225 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:45:49.308833 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:45:50.707959 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:45:50.708045 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:45:50.708124 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:45:50.708188 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:45:50.708254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:45:50.708318 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:45:50.708378 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:45:51.013927 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:46:19.576649 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:46:19.576762 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:46:19.576842 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:46:19.576920 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:46:19.576999 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:46:19.577091 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:46:19.577169 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:46:19.891974 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:46:21.277059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:46:21.277160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:46:21.277232 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:46:21.277332 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:46:21.277406 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:46:21.277485 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:46:21.277556 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:46:21.574814 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:46:40.929974 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:46:40.930067 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:46:40.930152 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:46:40.930240 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:46:40.930340 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:46:40.930429 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:46:40.930519 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:46:41.235644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:46:50.164814 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:46:50.164911 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:46:50.164985 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:46:50.165055 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:46:50.165121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:46:50.165193 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:46:50.165257 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:46:50.470306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:46:51.840093 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:46:51.840180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:46:51.840253 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:46:51.840322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:46:51.840388 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:46:51.840452 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:46:51.840513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:46:52.158819 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:47:20.733807 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:47:20.733885 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:47:20.733962 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:47:20.734030 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:47:20.734093 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:47:20.734152 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:47:20.734217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:47:21.035589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:47:22.421544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:47:22.421636 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:47:22.421711 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:47:22.421784 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:47:22.421848 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:47:22.421911 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:47:22.421972 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:47:22.735389 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:47:41.047622 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:47:41.047725 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:47:41.047815 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:47:41.047893 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:47:41.047968 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:47:41.048046 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:47:41.048129 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:47:41.353489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:47:51.297146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:47:51.297267 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:47:51.297365 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:47:51.297444 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:47:51.297525 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:47:51.299021 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:47:51.299657 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:47:51.599947 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:47:52.999362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:47:52.999451 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:47:52.999524 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:47:52.999589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:47:52.999663 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:47:52.999741 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:47:52.999806 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:47:53.309832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:48:21.861038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:48:21.861135 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:48:21.861223 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:48:21.861305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:48:21.861389 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:48:21.861468 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:48:21.861548 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:48:22.177226 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:48:23.571881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:48:23.571985 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:48:23.572058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:48:23.572143 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:48:23.572220 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:48:23.572297 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:48:23.572371 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:48:23.875316 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:48:41.167078 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:48:41.167172 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:48:41.167249 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:48:41.167321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:48:41.167399 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:48:41.167470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:48:41.167544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:48:41.485495 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:48:52.437917 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:48:52.438012 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:48:52.438077 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:48:52.438148 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:48:52.438205 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:48:52.438272 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:48:52.438340 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:48:52.739525 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:48:54.138686 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:48:54.138798 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:48:54.138883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:48:54.138965 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:48:54.139038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:48:54.139116 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:48:54.139185 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:48:54.446512 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:49:23.005950 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:49:23.006043 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:49:23.006124 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:49:23.006187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:49:23.006260 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:49:23.006331 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:49:23.006389 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:49:23.310250 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:49:24.711696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:49:24.711789 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:49:24.711865 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:49:24.711933 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:49:24.711994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:49:24.712059 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:49:24.712120 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:49:25.021327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:49:41.287773 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:49:41.287849 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:49:41.287930 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:49:41.287997 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:49:41.288063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:49:41.288128 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:49:41.288195 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:49:41.604073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:49:53.576513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:49:53.576597 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:49:53.576678 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:49:53.576744 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:49:53.576820 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:49:53.576887 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:49:53.576948 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:49:53.883361 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:49:55.293197 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:49:55.293311 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:49:55.293385 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:49:55.293461 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:49:55.293521 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:49:55.293590 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:49:55.293652 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:49:55.606240 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:50:24.143137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:50:24.143236 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:50:24.143304 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:50:24.143381 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:50:24.143447 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:50:24.143513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:50:24.143574 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:50:24.453245 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:50:25.869053 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:50:25.869137 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:50:25.869203 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:50:25.869281 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:50:25.869341 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:50:25.869400 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:50:25.869456 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:50:26.171615 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:50:41.411450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:50:41.411541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:50:41.411601 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:50:41.411665 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:50:41.411742 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:50:41.411807 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:50:41.411869 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:50:41.722624 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:50:54.714141 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:50:54.714220 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:50:54.714285 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:50:54.714352 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:50:54.714413 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:50:54.714471 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:50:54.714540 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:50:55.030762 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:50:56.434107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:50:56.434200 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:50:56.434274 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:50:56.434339 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:50:56.434408 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:50:56.434482 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:50:56.434541 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:50:56.740383 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:51:25.308207 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:51:25.308344 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:51:25.308422 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:51:25.308489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:51:25.308550 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:51:25.308610 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:51:25.308681 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:51:25.609394 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:51:27.004317 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:51:27.004398 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:51:27.004466 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:51:27.004527 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:51:27.004590 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:51:27.004649 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:51:27.004710 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:51:27.306245 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:51:41.531965 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:51:41.532077 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:51:41.532163 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:51:41.532238 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:51:41.532325 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:51:41.532406 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:51:41.532476 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:51:41.842778 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:51:55.863306 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:51:55.863414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:51:55.863484 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:51:55.863562 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:51:55.863641 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:51:55.863708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:51:55.863796 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:51:56.166137 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:51:57.565504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:51:57.565591 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:51:57.565658 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:51:57.565750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:51:57.565815 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:51:57.565876 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:51:57.565941 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:51:57.867581 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:52:26.431423 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:52:26.431540 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:52:26.431637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:52:26.431730 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:52:26.431818 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:52:26.431909 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:52:26.431990 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:52:26.735677 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:52:28.130659 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:52:28.130784 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:52:28.130885 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:52:28.130982 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:52:28.131067 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:52:28.131156 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:52:28.131224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:52:28.443128 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:52:41.660843 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:52:41.660942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:52:41.661011 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:52:41.661087 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:52:41.661156 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:52:41.661222 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:52:41.661288 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:52:41.979323 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:52:56.994980 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:52:56.995094 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:52:56.995161 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:52:56.995243 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:52:56.995307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:52:56.995386 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:52:56.995457 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:52:57.305552 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:52:58.712844 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:52:58.712962 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:52:58.713035 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:52:58.713114 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:52:58.713183 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:52:58.713251 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:52:58.713326 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:52:59.023627 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:53:27.567492 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:53:27.567608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:53:27.567681 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:53:27.567766 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:53:27.567827 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:53:27.567897 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:53:27.567963 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:53:27.872423 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:53:29.285371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:53:29.285487 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:53:29.285566 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:53:29.285641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:53:29.285703 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:53:29.285770 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:53:29.285836 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:53:29.591407 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:53:41.787119 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:53:41.787205 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:53:41.787279 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:53:41.787346 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:53:41.787409 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:53:41.787470 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:53:41.787528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:53:42.104740 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:53:58.130122 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:53:58.130209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:53:58.130281 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:53:58.130369 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:53:58.130449 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:53:58.130518 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:53:58.130584 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:53:58.441323 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:53:59.850622 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:53:59.850699 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:53:59.850772 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:53:59.850833 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:53:59.850896 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:53:59.850955 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:53:59.851021 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:54:00.176885 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:54:28.698839 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:54:28.698922 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:54:28.698989 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:54:28.699051 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:54:28.699117 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:54:28.699166 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:54:28.699228 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:54:29.011538 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:54:30.448159 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:54:30.448281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:54:30.448364 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:54:30.448447 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:54:30.448512 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:54:30.448584 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:54:30.448647 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:54:30.751543 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:54:41.907566 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:54:41.907650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:54:41.907735 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:54:41.907808 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:54:41.907879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:54:41.907947 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:54:41.908012 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:54:42.219850 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:54:59.287127 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:54:59.287241 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:54:59.287314 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:54:59.287386 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:54:59.287454 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:54:59.287529 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:54:59.287604 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:54:59.594497 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:55:01.013891 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:55:01.013982 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:55:01.014052 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:55:01.014119 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:55:01.014177 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:55:01.014240 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:55:01.014298 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:55:01.326485 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:55:29.856575 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:55:29.856666 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:55:29.856733 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:55:29.856801 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:55:29.856860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:55:29.856920 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:55:29.856984 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:55:30.182062 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:55:31.587676 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:55:31.587765 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:55:31.587836 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:55:31.587903 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:55:31.587982 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:55:31.588038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:55:31.588094 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:55:31.904070 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:55:42.029236 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:55:42.029321 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:55:42.029383 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:55:42.029446 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:55:42.029508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:55:42.029584 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:55:42.029643 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:55:42.348692 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:56:00.446490 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:56:00.446571 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:56:00.446639 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:56:00.446703 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:56:00.446766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:56:00.446835 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:56:00.446892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:56:00.760404 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:56:02.186461 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:56:02.186550 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:56:02.186620 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:56:02.186685 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:56:02.186753 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:56:02.186823 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:56:02.186895 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:56:02.489429 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:56:31.021335 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:56:31.021438 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:56:31.021508 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:56:31.021570 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:56:31.021634 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:56:31.021699 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:56:31.021769 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:56:31.324134 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:56:32.747161 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:56:32.747247 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:56:32.747309 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:56:32.747369 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:56:32.747432 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:56:32.747492 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:56:32.747550 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:56:33.058505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:56:42.153391 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:56:42.153477 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:56:42.153544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:56:42.153612 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:56:42.153674 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:56:42.153741 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:56:42.153812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:56:42.460759 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:57:01.590414 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:57:01.590529 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:57:01.590628 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:57:01.590709 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:57:01.590813 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:57:01.590919 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:57:01.591008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:57:01.901587 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:57:03.324813 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:57:03.324910 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:57:03.324983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:57:03.325060 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:57:03.325131 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:57:03.325199 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:57:03.325275 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:57:03.631715 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:57:32.189897 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:57:32.189995 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:57:32.190075 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:57:32.190152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:57:32.190230 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:57:32.190306 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:57:32.190386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:57:32.489744 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:57:33.892852 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:57:33.892954 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:57:33.893023 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:57:33.893102 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:57:33.893168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:57:33.893236 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:57:33.893309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:57:34.212257 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:57:42.278802 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:57:42.278887 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:57:42.278961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:57:42.279022 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:57:42.279085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:57:42.279148 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:57:42.279214 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:57:42.577157 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:58:02.747981 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:58:02.748097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:58:02.748168 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:58:02.748233 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:58:02.748296 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:58:02.748360 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:58:02.748421 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:58:03.049664 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:58:04.475370 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:58:04.476227 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:58:04.476375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:58:04.476464 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:58:04.476543 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:58:04.476626 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:58:04.476731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:58:04.777353 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:58:33.328161 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:58:33.328263 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:58:33.328364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:58:33.328449 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:58:33.328524 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:58:33.328601 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:58:33.328679 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:58:33.629741 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:58:35.044097 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:58:35.044210 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:58:35.044288 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:58:35.044355 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:58:35.044433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:58:35.044501 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:58:35.044574 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:58:35.351996 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:58:42.400662 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:58:42.400754 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:58:42.400827 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:58:42.400890 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:58:42.400959 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:58:42.401025 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:58:42.401096 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:58:42.710126 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:59:03.887531 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:59:03.887614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:59:03.887684 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:59:03.887760 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:59:03.887821 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:59:03.887881 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:59:03.887944 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:59:04.220584 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:59:05.615851 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:59:05.615945 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:59:05.616031 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:59:05.616107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:59:05.616185 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:59:05.616258 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:59:05.616329 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:59:05.916815 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:59:34.487590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:59:34.487695 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:59:34.487806 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:59:34.487876 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:59:34.487936 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:59:34.488000 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:59:34.488082 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:59:34.796895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:59:36.182833 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:59:36.182937 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:59:36.183017 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:59:36.183101 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:59:36.183184 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:59:36.183265 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:59:36.183352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:59:36.486877 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 07:59:42.608951 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 07:59:42.609055 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 07:59:42.609127 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 07:59:42.609203 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 07:59:42.609269 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 07:59:42.609347 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 07:59:42.609413 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 07:59:42.928470 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:00:05.071847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:00:05.071927 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:00:05.071992 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:00:05.072063 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:00:05.072122 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:00:05.072186 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:00:05.072250 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:00:05.387193 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:00:06.749366 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:00:06.749454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:00:06.749521 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:00:06.749583 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:00:06.749646 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:00:06.749709 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:00:06.749782 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:00:07.058776 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:00:35.648414 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:00:35.648515 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:00:35.648586 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:00:35.648653 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:00:35.648726 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:00:35.648791 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:00:35.648849 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:00:35.959080 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:00:37.322321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:00:37.322404 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:00:37.322465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:00:37.322530 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:00:37.322593 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:00:37.322656 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:00:37.322721 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:00:37.627489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:00:43.307880 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:00:43.307965 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:00:43.308033 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:00:43.308095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:00:43.308157 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:00:43.308220 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:00:43.308288 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:00:43.626545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:01:06.217547 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:01:06.217642 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:01:06.217706 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:01:06.217777 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:01:06.217851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:01:06.217917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:01:06.217975 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:01:06.523573 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:01:07.889118 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:01:07.889224 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:01:07.889319 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:01:07.889404 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:01:07.889468 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:01:07.889529 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:01:07.889598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:01:08.193917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:01:36.783039 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:01:36.783129 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:01:36.783195 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:01:36.783255 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:01:36.783326 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:01:36.783388 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:01:36.783452 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:01:37.101658 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:01:38.459417 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:01:38.459504 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:01:38.459581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:01:38.459645 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:01:38.459705 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:01:38.459787 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:01:38.459845 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:01:38.762523 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:01:43.427183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:01:43.427261 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:01:43.427335 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:01:43.427397 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:01:43.427461 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:01:43.427520 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:01:43.427583 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:01:43.736624 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:02:07.368120 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:02:07.368228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:02:07.368303 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:02:07.368367 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:02:07.368426 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:02:07.368486 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:02:07.368543 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:02:07.677361 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:02:09.021217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:02:09.021307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:02:09.021381 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:02:09.021447 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:02:09.021516 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:02:09.021575 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:02:09.021640 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:02:09.325193 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:02:28.896970 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:02:28.897095 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:02:28.897186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:02:28.897269 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:02:28.897350 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:02:28.897432 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:02:28.897511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:02:29.226264 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:02:37.934858 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:02:37.934958 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:02:37.935033 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:02:37.935106 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:02:37.935170 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:02:37.935239 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:02:37.935309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:02:38.243406 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:02:39.588285 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:02:39.588365 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:02:39.588431 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:02:39.588494 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:02:39.588571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:02:39.588633 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:02:39.588695 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:02:39.891148 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:02:43.550370 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:02:43.550454 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:02:43.550518 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:02:43.550582 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:02:43.550643 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:02:43.550701 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:02:43.550769 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:02:43.854897 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:03:08.508076 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:03:08.508158 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:03:08.508225 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:03:08.508304 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:03:08.508373 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:03:08.508436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:03:08.508499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:03:08.809206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:03:10.161677 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:03:10.161769 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:03:10.161839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:03:10.161904 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:03:10.161965 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:03:10.162029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:03:10.162096 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:03:10.467435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:03:39.070318 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:03:39.070421 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:03:39.070489 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:03:39.070561 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:03:39.070648 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:03:39.070734 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:03:39.070812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:03:39.379261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:03:40.726662 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:03:40.726760 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:03:40.726827 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:03:40.726889 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:03:40.726950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:03:40.727012 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:03:40.727071 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:03:41.027969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:03:43.673750 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:03:43.673830 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:03:43.673894 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:03:43.673965 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:03:43.674028 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:03:43.674091 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:03:43.674147 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:03:43.985742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:04:09.638243 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:04:09.638327 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:04:09.638410 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:04:09.638475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:04:09.638536 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:04:09.638594 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:04:09.638658 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:04:09.947843 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:04:11.293062 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:04:11.293141 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:04:11.293209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:04:11.293288 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:04:11.293351 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:04:11.293413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:04:11.293476 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:04:11.602085 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:04:40.207377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:04:40.207470 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:04:40.207529 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:04:40.207599 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:04:40.207660 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:04:40.207733 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:04:40.207797 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:04:40.515517 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:04:41.862691 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:04:41.862809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:04:41.862885 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:04:41.862954 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:04:41.863017 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:04:41.863092 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:04:41.863154 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:04:42.190530 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:04:43.795775 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:04:43.795853 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:04:43.795930 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:04:43.796003 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:04:43.796087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:04:43.796147 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:04:43.796206 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:04:44.103218 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:05:10.779995 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:05:10.780086 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:05:10.780157 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:05:10.780226 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:05:10.780291 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:05:10.780350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:05:10.780412 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:05:11.086544 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:05:12.455694 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:05:12.455787 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:05:12.455847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:05:12.455916 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:05:12.455974 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:05:12.456040 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:05:12.456102 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:05:12.761302 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:05:41.353601 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:05:41.353689 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:05:41.353768 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:05:41.353830 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:05:41.353899 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:05:41.353962 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:05:41.354024 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:05:41.660954 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:05:43.031094 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:05:43.031629 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:05:43.032145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:05:43.032229 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:05:43.032302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:05:43.032402 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:05:43.032472 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:05:43.340067 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:05:43.915726 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:05:43.915811 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:05:43.915883 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:05:43.915949 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:05:43.916023 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:05:43.916092 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:05:43.916157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:05:44.243382 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:06:11.937369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:06:11.937499 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:06:11.937583 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:06:11.937670 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:06:11.937755 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:06:11.937840 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:06:11.937917 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:06:12.269800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:06:13.602239 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:06:13.602357 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:06:13.602436 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:06:13.602519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:06:13.602597 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:06:13.602674 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:06:13.602754 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:06:13.915018 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:06:42.540232 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:06:42.540338 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:06:42.540419 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:06:42.540495 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:06:42.540577 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:06:42.540649 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:06:42.540737 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:06:42.843849 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:06:44.043912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:06:44.044008 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:06:44.044087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:06:44.044166 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:06:44.044238 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:06:44.044328 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:06:44.044399 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:06:44.353663 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:06:44.619652 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:06:44.620160 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:06:44.620443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:06:44.621129 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:06:44.621294 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:06:44.621377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:06:44.621459 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:06:44.921881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:07:13.103497 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:07:13.103607 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:07:13.103687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:07:13.103781 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:07:13.103859 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:07:13.103938 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:07:13.104015 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:07:13.410188 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:07:15.193023 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:07:15.193123 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:07:15.193196 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:07:15.193272 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:07:15.193352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:07:15.193432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:07:15.193498 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:07:15.495983 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:07:43.672177 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:07:43.672288 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:07:43.672369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:07:43.672451 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:07:43.672533 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:07:43.672612 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:07:43.672692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:07:43.978149 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:07:44.241503 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:07:44.241602 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:07:44.241684 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:07:44.241778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:07:44.241865 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:07:44.241944 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:07:44.242020 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:07:44.552484 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:07:45.751998 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:07:45.752085 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:07:45.752171 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:07:45.752247 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:07:45.752317 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:07:45.752389 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:07:45.752466 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:07:46.058056 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:08:14.243073 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:08:14.243178 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:08:14.243256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:08:14.243334 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:08:14.243405 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:08:14.243474 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:08:14.243548 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:08:14.556756 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:08:16.314852 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:08:16.314943 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:08:16.315014 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:08:16.315085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:08:16.315148 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:08:16.315214 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:08:16.315273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:08:16.618142 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:08:44.292320 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:08:44.292416 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:08:44.292486 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:08:44.292566 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:08:44.292633 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:08:44.292705 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:08:44.292775 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:08:44.602981 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:08:44.865136 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:08:44.865222 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:08:44.865328 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:08:44.865398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:08:44.865477 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:08:44.865545 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:08:44.865618 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:08:45.165821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:08:46.877296 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:08:46.877387 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:08:46.877468 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:08:46.877545 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:08:46.877620 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:08:46.877687 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:08:46.877769 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:08:47.179466 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:09:14.866671 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:09:14.866777 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:09:14.866849 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:09:14.866913 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:09:14.866981 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:09:14.867033 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:09:14.867099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:09:15.174454 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:09:17.440603 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:09:17.440699 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:09:17.440768 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:09:17.440844 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:09:17.440904 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:09:17.440970 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:09:17.441030 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:09:17.748179 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:09:44.410272 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:09:44.410350 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:09:44.410418 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:09:44.410481 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:09:44.410545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:09:44.410611 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:09:44.410674 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:09:44.721276 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:09:45.429263 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:09:45.429354 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:09:45.429416 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:09:45.429490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:09:45.429550 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:09:45.429611 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:09:45.429673 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:09:45.733024 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:09:48.013509 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:09:48.013593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:09:48.013673 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:09:48.013741 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:09:48.013807 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:09:48.013866 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:09:48.013933 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:09:48.335982 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:10:15.996471 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:10:15.996714 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:10:15.996903 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:10:15.997459 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:10:15.998754 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:10:15.998875 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:10:15.998948 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:10:16.300582 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:10:18.599178 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:10:18.599262 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:10:18.599328 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:10:18.599392 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:10:18.599459 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:10:18.599534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:10:18.599596 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:10:18.902792 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:10:44.530184 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:10:44.530268 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:10:44.530337 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:10:44.530406 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:10:44.530472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:10:44.530542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:10:44.530600 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:10:44.837005 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:10:46.558937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:10:46.559032 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:10:46.559093 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:10:46.559160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:10:46.559222 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:10:46.559286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:10:46.559345 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:10:46.861929 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:10:49.160333 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:10:49.160417 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:10:49.160481 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:10:49.160554 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:10:49.160617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:10:49.160682 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:10:49.160753 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:10:49.475292 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:11:17.124787 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:11:17.124872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:11:17.124937 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:11:17.125016 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:11:17.125080 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:11:17.125169 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:11:17.125231 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:11:17.434263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:11:19.736868 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:11:19.736976 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:11:19.737058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:11:19.737138 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:11:19.737211 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:11:19.737293 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:11:19.737363 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:11:20.063699 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:11:44.653698 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:11:44.653787 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:11:44.653859 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:11:44.653928 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:11:44.653999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:11:44.654069 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:11:44.654142 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:11:44.959097 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:11:47.689388 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:11:47.689472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:11:47.689540 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:11:47.689606 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:11:47.689669 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:11:47.689743 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:11:47.689810 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:11:47.989745 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:11:50.335866 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:11:50.335969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:11:50.336037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:11:50.336107 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:11:50.336163 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:11:50.336229 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:11:50.336289 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:11:50.640066 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:12:18.246842 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:12:18.246935 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:12:18.247002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:12:18.247068 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:12:18.247133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:12:18.247197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:12:18.247257 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:12:18.561686 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 08:12:20.898746 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:12:20.898857 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:12:20.898924 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:12:20.898983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:12:20.899058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:12:20.899117 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:12:20.899177 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:12:21.209988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 08:12:44.779542 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:12:44.779630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:12:44.779728 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:12:44.779800 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:12:44.779893 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:12:44.779986 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:12:44.780069 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:12:45.089762 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 08:12:48.832264 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:12:48.832348 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:12:48.832432 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:12:48.832506 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:12:48.832570 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:12:48.832635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:12:48.832693 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:12:49.138774 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 08:12:51.464981 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:12:51.465063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:12:51.465133 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:12:51.465198 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:12:51.465269 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:12:51.465335 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:12:51.465402 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:12:51.764425 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:13:19.399434 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:13:19.399534 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:13:19.399612 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:13:19.399692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:13:19.399760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:13:19.399826 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:13:19.399883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:13:19.706558 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:13:22.033058 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:13:22.033142 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:13:22.033207 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:13:22.033268 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:13:22.033336 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:13:22.033396 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:13:22.033466 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:13:22.344265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:13:44.902100 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:13:44.902176 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:13:44.902248 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:13:44.902317 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:13:44.902386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:13:44.902452 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:13:44.902518 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:13:45.208486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:13:49.972912 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:13:49.973006 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:13:49.973079 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:13:49.973164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:13:49.973247 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:13:49.973313 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:13:49.973389 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:13:50.342805 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:13:52.604855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:13:52.604965 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:13:52.605030 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:13:52.605102 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:13:52.605174 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:13:52.605244 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:13:52.605311 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:13:52.907119 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:14:20.621850 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:14:20.621930 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:14:20.622013 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:14:20.622085 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:14:20.622163 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:14:20.622228 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:14:20.622289 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:14:20.926879 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:14:23.164592 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:14:23.164704 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:14:23.164789 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:14:23.164866 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:14:23.164948 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:14:23.165018 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:14:23.165091 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:14:23.468477 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:14:45.032263 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:14:45.032377 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:14:45.032456 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:14:45.032527 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:14:45.032598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:14:45.032664 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:14:45.032754 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:14:45.332877 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:14:51.181914 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:14:51.181995 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:14:51.182060 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:14:51.182125 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:14:51.182183 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:14:51.182259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:14:51.182323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:14:51.485389 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:14:53.729730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:14:53.729825 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:14:53.729893 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:14:53.729959 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:14:53.730020 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:14:53.730082 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:14:53.730147 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:14:54.030321 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:15:21.749670 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:15:21.749760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:15:21.749823 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:15:21.749884 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:15:21.749950 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:15:21.750012 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:15:21.750080 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:15:22.077328 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:15:24.301054 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:15:24.301148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:15:24.301216 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:15:24.301276 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:15:24.301346 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:15:24.301408 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:15:24.301473 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:15:24.609372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:15:45.158775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:15:45.158855 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:15:45.158922 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:15:45.158998 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:15:45.159056 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:15:45.159131 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:15:45.159194 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:15:45.479094 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:15:52.346707 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:15:52.346812 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:15:52.346874 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:15:52.346945 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:15:52.347013 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:15:52.347073 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:15:52.347138 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:15:52.647713 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:15:54.873671 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:15:54.873777 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:15:54.873862 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:15:54.873942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:15:54.874033 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:15:54.874108 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:15:54.874187 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:15:55.186045 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:16:22.907410 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:16:22.907503 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:16:22.907574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:16:22.907641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:16:22.907704 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:16:22.907773 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:16:22.907837 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:16:23.207753 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:16:25.453076 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:16:25.453162 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:16:25.453242 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:16:25.453306 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:16:25.453374 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:16:25.453433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:16:25.453496 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:16:25.760567 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:16:45.288706 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:16:45.288788 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:16:45.288854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:16:45.288920 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:16:45.288980 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:16:45.289040 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:16:45.289108 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:16:45.602444 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:16:53.470869 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:16:53.470977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:16:53.471041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:16:53.471107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:16:53.471170 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:16:53.471231 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:16:53.471290 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:16:53.775610 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:16:56.022935 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:16:56.023026 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:16:56.023096 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:16:56.023159 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:16:56.023222 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:16:56.023283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:16:56.023352 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:16:56.331858 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:17:24.035619 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:17:24.035713 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:17:24.035785 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:17:24.035858 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:17:24.035923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:17:24.035994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:17:24.036057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:17:24.350009 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:17:26.598135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:17:26.598246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:17:26.598304 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:17:26.598372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:17:26.598430 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:17:26.598490 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:17:26.598546 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:17:26.906058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:17:45.417980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:17:45.418088 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:17:45.418164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:17:45.418249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:17:45.418325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:17:45.418414 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:17:45.418499 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:17:45.729427 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:17:54.611070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:17:54.611169 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:17:54.611254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:17:54.611328 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:17:54.611403 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:17:54.611482 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:17:54.611558 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:17:54.915837 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:17:57.169724 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:17:57.169839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:17:57.169919 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:17:57.169991 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:17:57.170066 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:17:57.170143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:17:57.170215 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:17:57.487246 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:18:25.184253 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:18:25.184366 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:18:25.184457 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:18:25.184544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:18:25.184630 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:18:25.184708 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:18:25.184794 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:18:25.493529 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:18:27.751318 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:18:27.751421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:18:27.751499 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:18:27.751572 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:18:27.751649 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:18:27.751723 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:18:27.751811 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:18:28.053956 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:18:45.544631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:18:45.544710 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:18:45.544793 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:18:45.544860 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:18:45.544926 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:18:45.544987 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:18:45.545052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:18:45.850266 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:18:55.757800 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:18:55.757889 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:18:55.757964 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:18:55.758038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:18:55.758101 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:18:55.758167 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:18:55.758229 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:18:56.065341 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:18:58.320545 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:18:58.320655 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:18:58.320728 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:18:58.320791 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:18:58.320867 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:18:58.320926 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:18:58.320991 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:18:58.623972 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:19:17.534180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:19:17.534297 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:19:17.534363 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:19:17.534430 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:19:17.534494 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:19:17.534558 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:19:17.534624 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:19:17.849710 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:19:26.329202 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:19:26.329612 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:19:26.329891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:19:26.330083 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:19:26.330294 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:19:26.330487 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:19:26.331349 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:19:26.632237 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:19:28.887752 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:19:28.887839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:19:28.887906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:19:28.887973 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:19:28.888038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:19:28.888104 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:19:28.888169 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:19:29.209924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:19:45.671115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:19:45.671194 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:19:45.671263 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:19:45.671323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:19:45.671387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:19:45.671450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:19:45.671516 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:19:45.971157 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:19:56.894280 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:19:56.894404 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:19:56.894487 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:19:56.894566 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:19:56.894646 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:19:56.894729 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:19:56.894803 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:19:57.209206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:19:59.473764 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:19:59.473879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:19:59.473966 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:19:59.474047 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:19:59.474122 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:19:59.474207 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:19:59.474295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:19:59.777122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:20:27.471421 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:20:27.471538 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:20:27.471626 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:20:27.471712 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:20:27.471797 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:20:27.471879 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:20:27.471950 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:20:27.781248 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:20:30.032651 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:20:30.033849 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:20:30.034145 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:20:30.034756 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:20:30.035481 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:20:30.036182 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:20:30.036281 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:20:30.348103 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:20:45.800235 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:20:45.800348 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:20:45.800439 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:20:45.800531 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:20:45.800613 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:20:45.800695 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:20:45.800779 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:20:46.103629 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:20:58.039881 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:20:58.039980 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:20:58.040061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:20:58.040134 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:20:58.040208 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:20:58.040278 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:20:58.040344 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:20:58.343297 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:21:00.616280 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:21:00.616375 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:21:00.616442 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:21:00.616503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:21:00.616566 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:21:00.616630 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:21:00.616691 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:21:00.923221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:21:28.608022 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:21:28.608108 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:21:28.608195 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:21:28.608264 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:21:28.608327 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:21:28.608395 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:21:28.608458 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:21:28.923792 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:21:31.184972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:21:31.185049 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:21:31.185125 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:21:31.185187 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:21:31.185250 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:21:31.185322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:21:31.185388 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:21:31.483904 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:21:45.926079 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:21:45.926504 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:21:45.926732 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:21:45.927444 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:21:45.927556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:21:45.927640 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:21:45.927728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:21:46.232086 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:21:59.185124 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:21:59.185212 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:21:59.185281 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:21:59.185354 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:21:59.185414 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:21:59.185479 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:21:59.185546 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:21:59.496812 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:22:01.745204 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:22:01.745307 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:22:01.745370 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:22:01.745427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:22:01.745497 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:22:01.745558 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:22:01.745620 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:22:02.092968 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:22:29.753743 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:22:29.753842 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:22:29.753909 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:22:29.753974 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:22:29.754037 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:22:29.754106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:22:29.754169 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:22:30.064576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:22:32.370441 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:22:32.370554 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:22:32.370617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:22:32.370677 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:22:32.370759 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:22:32.370822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:22:32.370886 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:22:32.673421 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:22:46.051387 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:22:46.051469 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:22:46.051531 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:22:46.051599 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:22:46.051657 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:22:46.051740 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:22:46.051803 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:22:46.361214 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:23:00.344148 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:23:00.344238 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:23:00.344315 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:23:00.344377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:23:00.344446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:23:00.344512 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:23:00.344579 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:23:00.648620 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:23:02.939415 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:23:02.939525 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:23:02.939598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:23:02.939665 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:23:02.939741 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:23:02.939808 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:23:02.939886 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:23:03.257921 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:23:30.913701 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:23:30.913796 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:23:30.913865 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:23:30.913937 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:23:30.914002 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:23:30.914069 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:23:30.914145 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:23:31.230698 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:23:33.526130 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:23:33.526215 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:23:33.526282 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:23:33.526352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:23:33.526418 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:23:33.526488 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:23:33.526559 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:23:33.835328 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:23:46.180507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:23:46.180624 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:23:46.180709 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:23:46.180796 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:23:46.180883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:23:46.180957 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:23:46.181029 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:23:46.487820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:24:01.498249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:24:01.498357 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:24:01.498443 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:24:01.498520 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:24:01.498587 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:24:01.498662 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:24:01.498740 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:24:01.821348 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:24:04.097257 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:24:04.097368 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:24:04.097447 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:24:04.097524 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:24:04.097649 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:24:04.097777 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:24:04.097869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:24:04.409391 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:24:32.105855 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:24:32.105945 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:24:32.106014 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:24:32.106082 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:24:32.106166 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:24:32.106234 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:24:32.106305 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:24:32.414127 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:24:34.671053 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:24:34.671135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:24:34.671215 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:24:34.671282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:24:34.671359 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:24:34.671424 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:24:34.671490 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:24:34.988118 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:24:46.305146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:24:46.305224 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:24:46.305297 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:24:46.305361 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:24:46.305424 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:24:46.305488 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:24:46.305559 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:24:46.653701 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:25:02.678180 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:25:02.678279 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:25:02.678365 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:25:02.678442 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:25:02.678524 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:25:02.678610 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:25:02.678683 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:25:02.981034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:25:05.254474 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:25:05.254951 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:25:05.255237 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:25:05.255855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:25:05.255946 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:25:05.256028 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:25:05.256105 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:25:05.562129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:25:33.241941 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:25:33.242034 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:25:33.242114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:25:33.242187 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:25:33.242262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:25:33.242328 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:25:33.242403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:25:33.575078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:25:35.819300 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:25:35.819382 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:25:35.819458 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:25:35.819528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:25:35.819603 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:25:35.819672 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:25:35.819753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:25:36.127082 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:25:46.433479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:25:46.433564 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:25:46.433630 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:25:46.433699 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:25:46.433771 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:25:46.433838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:25:46.433897 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:25:46.765125 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:26:03.873102 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:26:03.873231 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:26:03.873300 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:26:03.873364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:26:03.873428 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:26:03.873491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:26:03.873554 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:26:04.176816 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:26:06.392707 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:26:06.392800 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:26:06.392871 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:26:06.392943 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:26:06.393006 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:26:06.393069 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:26:06.393130 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:26:06.698714 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:26:34.447560 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:26:34.447659 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:26:34.447731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:26:34.447804 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:26:34.447869 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:26:34.447934 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:26:34.447997 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:26:34.754217 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:26:36.962096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:26:36.962178 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:26:36.962248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:26:36.962302 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:26:36.962363 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:26:36.962423 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:26:36.962491 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:26:37.272475 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:26:46.560611 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:26:46.560691 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:26:46.560770 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:26:46.560833 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:26:46.560897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:26:46.560965 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:26:46.561027 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:26:46.867963 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:27:05.017205 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:27:05.017305 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:27:05.017368 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:27:05.017429 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:27:05.017495 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:27:05.017556 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:27:05.017617 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:27:05.324447 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:27:07.540268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:27:07.540389 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:27:07.540466 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:27:07.540548 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:27:07.540623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:27:07.540698 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:27:07.540786 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:27:07.844129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:27:35.597243 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:27:35.597810 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:27:35.598041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:27:35.598781 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:27:35.598902 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:27:35.598994 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:27:35.599075 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:27:35.909268 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:27:38.110604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:27:38.110699 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:27:38.110787 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:27:38.110860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:27:38.110929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:27:38.110995 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:27:38.111057 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:27:38.421804 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:27:46.691666 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:27:46.691762 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:27:46.691829 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:27:46.691892 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:27:46.691956 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:27:46.692015 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:27:46.692080 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:27:46.997811 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:28:06.169473 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:28:06.169555 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:28:06.169629 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:28:06.169693 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:28:06.169768 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:28:06.169833 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:28:06.169909 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:28:06.488783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:28:08.684277 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:28:08.684357 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:28:08.684429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:28:08.684492 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:28:08.684557 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:28:08.684620 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:28:08.684685 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:28:08.993520 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:28:36.754143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:28:36.754229 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:28:36.754307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:28:36.754384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:28:36.754445 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:28:36.754508 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:28:36.754572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:28:37.060221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:28:39.264966 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:28:39.265054 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:28:39.265117 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:28:39.265180 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:28:39.265244 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:28:39.265305 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:28:39.265365 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:28:39.571978 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:28:46.825433 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:28:46.825524 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:28:46.825602 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:28:46.825696 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:28:46.825795 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:28:46.825883 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:28:46.825966 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:28:47.128333 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:29:07.323604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:29:07.323697 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:29:07.323776 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:29:07.323846 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:29:07.323921 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:29:07.323991 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:29:07.324064 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:29:07.619480 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:29:09.831190 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:29:09.831288 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:29:09.831353 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:29:09.831417 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:29:09.831476 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:29:09.831538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:29:09.831597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:29:10.147435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:29:37.874536 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:29:37.874619 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:29:37.874691 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:29:37.874763 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:29:37.874834 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:29:37.874895 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:29:37.874957 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:29:38.180592 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:29:40.415595 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:29:40.415677 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:29:40.415759 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:29:40.415825 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:29:40.415890 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:29:40.415957 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:29:40.416021 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:29:40.718254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:29:46.957025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:29:46.957116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:29:46.957186 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:29:46.957248 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:29:46.957317 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:29:46.957377 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:29:46.957440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:29:47.264661 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:30:08.437527 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:30:08.437650 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:30:08.437705 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:30:08.437788 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:30:08.437878 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:30:08.437972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:30:08.438053 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:30:08.745214 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:30:10.981267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:30:10.981376 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:30:10.981443 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:30:10.981528 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:30:10.981601 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:30:10.981683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:30:10.981757 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:30:11.287071 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:30:39.012367 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:30:39.012485 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:30:39.012583 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:30:39.012668 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:30:39.012760 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:30:39.012839 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:30:39.012922 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:30:39.347372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:30:41.550173 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:30:41.550278 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:30:41.550391 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:30:41.550473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:30:41.550553 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:30:41.550625 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:30:41.550722 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:30:41.864645 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:30:47.086381 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:30:47.086501 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:30:47.086582 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:30:47.086675 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:30:47.086765 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:30:47.086843 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:30:47.086921 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:30:47.394430 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:31:09.608993 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:31:09.609105 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:31:09.609171 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:31:09.609238 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:31:09.609301 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:31:09.609367 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:31:09.609430 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:31:09.911154 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:31:12.140276 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:31:12.140388 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:31:12.140463 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:31:12.140532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:31:12.140601 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:31:12.140660 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:31:12.140743 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:31:12.443593 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:31:40.169887 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:31:40.169968 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:31:40.170042 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:31:40.170110 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:31:40.170176 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:31:40.170244 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:31:40.170306 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:31:40.476073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:31:42.703497 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:31:42.703581 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:31:42.703644 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:31:42.703712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:31:42.703784 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:31:42.703846 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:31:42.703918 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:31:43.009543 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:31:47.213829 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:31:47.213911 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:31:47.213976 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:31:47.214042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:31:47.214114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:31:47.214184 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:31:47.214249 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:31:47.519020 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:32:10.735200 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:32:10.735306 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:32:10.735367 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:32:10.735430 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:32:10.735493 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:32:10.735557 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:32:10.735620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:32:11.050255 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:32:13.280030 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:32:13.280141 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:32:13.280207 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:32:13.280273 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:32:13.280337 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:32:13.280404 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:32:13.280466 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:32:13.585479 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:32:41.310213 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:32:41.310295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:32:41.310366 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:32:41.310425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:32:41.310488 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:32:41.310559 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:32:41.310620 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:32:41.617022 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:32:43.841833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:32:43.841916 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:32:43.841978 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:32:43.842056 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:32:43.842119 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:32:43.842186 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:32:43.842243 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:32:44.146302 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:32:47.342468 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:32:47.342548 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:32:47.342621 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:32:47.342691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:32:47.342765 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:32:47.342830 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:32:47.342894 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:32:47.646509 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:33:11.881010 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:33:11.881137 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:33:11.881207 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:33:11.881287 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:33:11.881376 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:33:11.881464 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:33:11.881545 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:33:12.207025 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:33:14.412834 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:33:14.412916 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:33:14.413002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:33:14.413072 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:33:14.413140 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:33:14.413205 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:33:14.413266 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:33:14.726535 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:33:42.473683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:33:42.473773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:33:42.473840 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:33:42.473910 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:33:42.473974 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:33:42.474043 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:33:42.474115 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:33:42.782658 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:33:44.989330 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:33:44.989412 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:33:44.989494 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:33:44.989559 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:33:44.989618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:33:44.989684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:33:44.989769 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:33:45.301488 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:33:47.470036 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:33:47.470126 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:33:47.470198 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:33:47.470263 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:33:47.470332 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:33:47.470440 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:33:47.470518 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:33:47.790204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:34:13.043391 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:34:13.043481 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:34:13.043559 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:34:13.043629 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:34:13.043702 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:34:13.043774 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:34:13.043842 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:34:13.357643 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:34:15.559071 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:34:15.559151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:34:15.559225 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:34:15.559288 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:34:15.559353 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:34:15.559411 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:34:15.559471 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:34:15.864671 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:34:43.618992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:34:43.619092 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:34:43.619176 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:34:43.619256 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:34:43.619335 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:34:43.619413 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:34:43.619496 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:34:43.927845 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:34:46.127318 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:34:46.127409 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:34:46.127490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:34:46.127563 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:34:46.127636 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:34:46.127715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:34:46.127793 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:34:46.445883 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:34:47.597667 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:34:47.597757 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:34:47.597833 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:34:47.597901 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:34:47.597966 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:34:47.598028 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:34:47.598095 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:34:47.909931 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:35:14.195054 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:35:14.195156 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:35:14.195244 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:35:14.195330 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:35:14.195413 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:35:14.195489 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:35:14.195565 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:35:14.501895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:35:16.705117 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:35:16.705213 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:35:16.705283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:35:16.705365 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:35:16.705437 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:35:16.705507 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:35:16.705575 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:35:17.014913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:35:44.766084 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:35:44.766161 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:35:44.766232 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:35:44.766296 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:35:44.766356 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:35:44.766415 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:35:44.766479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:35:45.075036 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:35:47.280949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:35:47.281076 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:35:47.281163 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:35:47.281241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:35:47.281321 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:35:47.281390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:35:47.281473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:35:47.584107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:35:47.852078 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:35:47.852174 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:35:47.852253 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:35:47.852352 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:35:47.852432 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:35:47.852508 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:35:47.852582 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:35:48.158812 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:36:15.335051 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:36:15.335155 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:36:15.335238 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:36:15.335311 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:36:15.335400 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:36:15.335472 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:36:15.335547 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:36:15.636927 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:36:17.854251 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:36:17.854355 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:36:17.854439 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:36:17.854538 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:36:17.854609 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:36:17.854688 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:36:17.854778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:36:18.156892 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:36:45.898167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:36:45.898260 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:36:45.898333 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:36:45.898403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:36:45.898474 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:36:45.898554 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:36:45.898635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:36:46.212750 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:36:47.848628 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:36:47.848714 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:36:47.848784 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:36:47.848854 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:36:47.848923 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:36:47.848988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:36:47.849054 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:36:48.158299 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:36:48.419660 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:36:48.419767 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:36:48.419839 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:36:48.419926 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:36:48.420000 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:36:48.420080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:36:48.420155 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:36:48.725564 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:37:16.474659 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:37:16.474778 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:37:16.474847 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:37:16.474917 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:37:16.474977 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:37:16.475041 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:37:16.475114 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:37:16.775556 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:37:18.987416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:37:18.987528 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:37:18.987592 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:37:18.987663 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:37:18.987743 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:37:18.987813 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:37:18.987873 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:37:19.301923 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:37:47.033689 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:37:47.033812 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:37:47.033918 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:37:47.034000 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:37:47.034089 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:37:47.034168 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:37:47.034258 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:37:47.342082 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:37:47.988272 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:37:47.988368 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:37:47.988445 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:37:47.988516 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:37:47.988583 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:37:47.988653 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:37:47.988725 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:37:48.294159 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:37:49.567647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:37:49.567768 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:37:49.567852 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:37:49.567934 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:37:49.568007 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:37:49.568089 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:37:49.568165 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:37:49.873227 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:38:17.608747 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:38:17.608863 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:38:17.608937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:38:17.609022 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:38:17.609101 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:38:17.609181 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:38:17.609259 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:38:17.919013 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:38:20.145418 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:38:20.145518 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:38:20.145591 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:38:20.145662 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:38:20.145740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:38:20.145831 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:38:20.145902 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:38:20.452883 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:38:48.113550 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:38:48.113651 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:38:48.113748 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:38:48.113815 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:38:48.113887 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:38:48.113962 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:38:48.114028 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:38:48.418348 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:38:48.681189 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:38:48.681277 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:38:48.681346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:38:48.681413 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:38:48.681479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:38:48.681548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:38:48.681615 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:38:48.986778 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:38:50.710498 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:38:50.710583 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:38:50.710659 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:38:50.710729 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:38:50.710785 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:38:50.710846 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:38:50.710904 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:38:51.010164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:39:18.683560 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:39:18.683663 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:39:18.683745 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:39:18.683808 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:39:18.683891 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:39:18.683950 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:39:18.684012 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:39:18.994838 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:39:21.268699 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:39:21.268794 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:39:21.268860 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:39:21.268925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:39:21.268994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:39:21.269058 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:39:21.269121 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:39:21.566932 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:39:48.241006 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:39:48.241088 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:39:48.241152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:39:48.241214 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:39:48.241279 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:39:48.241346 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:39:48.241410 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:39:48.550038 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:39:49.264588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:39:49.264669 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:39:49.264750 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:39:49.264839 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:39:49.264909 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:39:49.264983 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:39:49.265054 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:39:49.568460 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:39:51.832203 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:39:51.832283 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:39:51.832356 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:39:51.832421 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:39:51.832486 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:39:51.832547 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:39:51.832611 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:39:52.138020 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:40:19.823775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:40:19.823867 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:40:19.823929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:40:19.824001 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:40:19.824080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:40:19.824141 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:40:19.824200 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:40:20.133580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:40:22.402713 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:40:22.402799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:40:22.402869 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:40:22.402934 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:40:22.402995 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:40:22.403053 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:40:22.403115 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:40:22.705523 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:40:48.371559 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:40:48.371638 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:40:48.371704 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:40:48.371775 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:40:48.371835 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:40:48.371898 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:40:48.371963 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:40:48.678202 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:40:50.401582 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:40:50.401667 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:40:50.401745 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:40:50.401818 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:40:50.401880 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:40:50.401952 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:40:50.402012 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:40:50.708464 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:40:52.964245 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:40:52.964331 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:40:52.964395 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:40:52.964466 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:40:52.964530 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:40:52.964588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:40:52.964647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:40:53.290050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:41:20.971656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:41:20.971753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:41:20.971824 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:41:20.971892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:41:20.971958 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:41:20.972026 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:41:20.972085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:41:21.279243 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:41:23.548431 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:41:23.548516 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:41:23.548588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:41:23.548650 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:41:23.548712 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:41:23.548788 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:41:23.548848 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:41:23.853668 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:41:48.499949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:41:48.500029 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:41:48.500096 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:41:48.500162 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:41:48.500225 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:41:48.500293 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:41:48.500354 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:41:48.809038 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:41:51.541989 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:41:51.542086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:41:51.542147 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:41:51.542209 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:41:51.542271 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:41:51.542334 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:41:51.542392 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:41:51.848486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:41:54.118553 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:41:54.118671 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:41:54.118760 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:41:54.118841 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:41:54.118927 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:41:54.119000 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:41:54.119083 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:41:54.434569 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:42:22.115078 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:42:22.115158 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:42:22.115229 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:42:22.115293 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:42:22.115363 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:42:22.115428 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:42:22.115493 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:42:22.429815 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:42:24.690849 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:42:24.690957 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:42:24.691047 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:42:24.691113 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:42:24.691183 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:42:24.691258 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:42:24.691327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:42:24.995564 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:42:48.625844 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:42:48.625929 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:42:48.625997 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:42:48.626068 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:42:48.626129 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:42:48.626192 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:42:48.626254 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:42:48.931288 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:42:52.688167 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:42:52.688256 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:42:52.688326 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:42:52.688395 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:42:52.688449 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:42:52.688505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:42:52.688567 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:42:52.994452 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:42:55.281611 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:42:55.281748 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:42:55.281825 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:42:55.281899 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:42:55.281967 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:42:55.282044 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:42:55.282109 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:42:55.591064 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:43:23.255211 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:43:23.255307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:43:23.255378 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:43:23.255439 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:43:23.255505 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:43:23.255562 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:43:23.255627 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:43:23.564673 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:43:25.851919 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:43:25.852006 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:43:25.852079 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:43:25.852150 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:43:25.852210 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:43:25.852274 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:43:25.852337 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:43:26.157805 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:43:48.754458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:43:48.754537 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:43:48.754613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:43:48.754680 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:43:48.754746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:43:48.754807 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:43:48.754865 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:43:49.066915 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:43:53.827450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:43:53.827531 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:43:53.827598 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:43:53.827659 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:43:53.827729 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:43:53.827794 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:43:53.827853 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:43:54.141787 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:43:56.423433 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:43:56.423534 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:43:56.423613 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:43:56.423692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:43:56.423779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:43:56.423857 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:43:56.423942 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:43:56.723668 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:44:24.407724 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:44:24.407836 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:44:24.407911 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:44:24.407988 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:44:24.408057 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:44:24.408131 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:44:24.408202 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:44:24.718886 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:44:26.987365 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:44:26.987459 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:44:26.988458 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:44:26.988865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:44:26.989151 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:44:26.989348 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:44:26.989970 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:44:27.295368 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:44:48.876452 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:44:48.876543 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:44:48.876627 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:44:48.876690 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:44:48.876766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:44:48.876832 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:44:48.876898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:44:49.188618 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:44:54.982808 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:44:54.982923 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:44:54.983016 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:44:54.983093 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:44:54.983180 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:44:54.983259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:44:54.983336 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:44:55.290811 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:44:57.555235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:44:57.555326 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:44:57.555405 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:44:57.555479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:44:57.555563 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:44:57.555645 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:44:57.555732 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:44:57.855831 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:45:25.548767 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:45:25.548865 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:45:25.548943 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:45:25.549008 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:45:25.549083 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:45:25.549156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:45:25.549229 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:45:25.855121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:45:28.120553 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:45:28.120664 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:45:28.120746 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:45:28.120827 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:45:28.120911 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:45:28.120983 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:45:28.121063 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:45:28.420807 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:45:49.007216 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:45:49.007299 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:45:49.007373 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:45:49.007432 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:45:49.007499 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:45:49.007557 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:45:49.007618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:45:49.326268 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:45:56.120928 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:45:56.121012 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:45:56.121079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:45:56.121151 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:45:56.121223 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:45:56.121288 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:45:56.121352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:45:56.431246 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:45:58.677348 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:45:58.677436 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:45:58.677507 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:45:58.677586 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:45:58.677653 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:45:58.677729 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:45:58.677791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:45:58.994809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:46:26.695499 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:46:26.695584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:46:26.695656 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:46:26.695728 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:46:26.695792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:46:26.695861 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:46:26.695923 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:46:27.007018 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:46:29.261784 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:46:29.261901 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:46:29.261983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:46:29.262049 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:46:29.262111 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:46:29.262174 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:46:29.262233 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:46:29.574493 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:46:49.126204 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:46:49.126281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:46:49.126348 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:46:49.126414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:46:49.126475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:46:49.126539 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:46:49.126607 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:46:49.445262 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:46:57.266527 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:46:57.266627 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:46:57.266694 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:46:57.266787 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:46:57.266866 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:46:57.266936 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:46:57.267000 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:46:57.573803 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:46:59.831887 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:46:59.831969 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:46:59.832033 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:46:59.832106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:46:59.832169 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:46:59.832231 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:46:59.832290 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:47:00.138122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:47:27.830131 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:47:27.830242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:47:27.830303 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:47:27.830368 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:47:27.830429 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:47:27.830497 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:47:27.830556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:47:28.139611 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:47:30.402781 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:47:30.402874 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:47:30.402946 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:47:30.403008 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:47:30.403076 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:47:30.403158 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:47:30.403227 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:47:30.713868 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:47:49.250110 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:47:49.250194 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:47:49.250276 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:47:49.250339 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:47:49.250411 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:47:49.250476 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:47:49.250545 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:47:49.562141 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:47:58.404547 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:47:58.404671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:47:58.404774 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:47:58.404881 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:47:58.404954 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:47:58.405045 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:47:58.405140 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:47:58.705492 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:48:00.975827 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:48:00.975922 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:48:00.976004 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:48:00.976081 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:48:00.976158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:48:00.976238 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:48:00.976309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:48:01.287073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:48:28.967748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:48:28.967857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:48:28.967926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:48:28.967996 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:48:28.968062 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:48:28.968128 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:48:28.968188 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:48:29.286113 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:48:31.548505 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:48:31.548595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:48:31.548672 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:48:31.548746 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:48:31.548807 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:48:31.548869 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:48:31.548933 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:48:31.850883 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:48:49.371994 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:48:49.372072 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:48:49.372135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:48:49.372198 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:48:49.372260 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:48:49.372326 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:48:49.372388 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:48:49.679157 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:48:59.550068 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:48:59.550163 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:48:59.550241 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:48:59.550305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:48:59.550373 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:48:59.550444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:48:59.550508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:48:59.858532 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:49:02.117800 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:49:02.117896 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:49:02.117971 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:49:02.118057 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:49:02.118146 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:49:02.118224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:49:02.118310 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:49:02.432814 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:49:30.123799 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:49:30.123884 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:49:30.123957 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:49:30.124020 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:49:30.124086 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:49:30.124151 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:49:30.124221 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:49:30.429757 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:49:32.696507 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:49:32.696601 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:49:32.696683 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:49:32.696759 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:49:32.696834 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:49:32.696896 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:49:32.696957 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:49:32.998414 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:49:49.500811 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:49:49.500911 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:49:49.500994 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:49:49.501071 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:49:49.501158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:49:49.501233 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:49:49.501308 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:49:49.806852 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:50:00.697283 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:50:00.697387 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:50:00.697480 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:50:00.697561 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:50:00.697634 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:50:00.697730 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:50:00.697810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:50:00.997646 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:50:03.267431 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:50:03.267522 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:50:03.267598 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:50:03.267684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:50:03.267764 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:50:03.267839 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:50:03.267904 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:50:03.569125 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:50:31.262802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:50:31.262894 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:50:31.262961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:50:31.263028 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:50:31.263095 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:50:31.263160 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:50:31.263225 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:50:31.567256 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:50:33.822509 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:50:33.822611 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:50:33.822691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:50:33.822771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:50:33.822847 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:50:33.822926 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:50:33.823003 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:50:34.127582 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:50:49.619919 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:50:49.620025 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:50:49.620097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:50:49.620158 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:50:49.620230 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:50:49.620296 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:50:49.620358 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:50:49.931134 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:51:01.834535 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:51:01.834617 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:51:01.834700 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:51:01.834772 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:51:01.834835 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:51:01.834894 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:51:01.834956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:51:02.160830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:51:04.393474 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:51:04.393573 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:51:04.393651 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:51:04.393716 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:51:04.393782 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:51:04.393850 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:51:04.393912 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:51:04.694311 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:51:32.438029 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:51:32.438137 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:51:32.438220 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:51:32.438282 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:51:32.438340 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:51:32.438416 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:51:32.438479 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:51:32.741129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:51:34.964500 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:51:34.964583 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:51:34.964660 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:51:34.964730 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:51:34.964791 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:51:34.964865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:51:34.964924 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:51:35.278399 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:51:49.747305 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:51:49.747388 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:51:49.747457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:51:49.747522 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:51:49.747590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:51:49.747658 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:51:49.747732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:51:50.076334 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:52:03.000983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:52:03.001073 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:52:03.001138 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:52:03.001201 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:52:03.001262 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:52:03.001340 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:52:03.001401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:52:03.308968 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:52:05.539832 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:52:05.539940 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:52:05.540001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:52:05.540064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:52:05.540123 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:52:05.540192 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:52:05.540255 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:52:05.840900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:52:33.571042 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:52:33.571128 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:52:33.571203 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:52:33.571274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:52:33.571330 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:52:33.571395 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:52:33.571455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:52:33.880793 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:52:36.097966 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:52:36.098061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:52:36.098136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:52:36.098243 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:52:36.098331 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:52:36.098422 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:52:36.098490 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:52:36.405429 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:52:49.875953 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:52:49.876052 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:52:49.876130 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:52:49.876209 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:52:49.876291 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:52:49.876372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:52:49.876448 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:52:50.191592 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:53:04.139444 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:53:04.139555 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:53:04.139642 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:53:04.139736 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:53:04.139824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:53:04.139898 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:53:04.139973 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:53:04.445161 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:53:06.667232 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:53:06.667353 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:53:06.667427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:53:06.667497 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:53:06.667568 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:53:06.667651 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:53:06.667726 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:53:06.976967 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:53:34.698969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:53:34.699077 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:53:34.699137 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:53:34.699200 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:53:34.699259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:53:34.699329 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:53:34.699384 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:53:35.011414 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:53:37.236767 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:53:37.236853 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:53:37.236935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:53:37.236995 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:53:37.237056 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:53:37.237119 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:53:37.237178 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:53:37.543377 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:53:49.999625 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:53:49.999704 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:53:49.999779 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:53:49.999845 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:53:49.999907 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:53:49.999967 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:53:50.000028 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:53:50.315784 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:54:05.274809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:54:05.274928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:54:05.274994 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:54:05.275060 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:54:05.275120 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:54:05.275185 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:54:05.275241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:54:05.588388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:54:07.807646 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:54:07.807763 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:54:07.807850 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:54:07.807913 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:54:07.807976 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:54:07.808040 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:54:07.808098 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:54:08.115862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:54:35.847449 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:54:35.847532 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:54:35.847596 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:54:35.847665 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:54:35.847738 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:54:35.847816 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:54:35.847884 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:54:36.155806 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:54:38.375662 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:54:38.375748 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:54:38.375833 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:54:38.375906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:54:38.375972 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:54:38.376035 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:54:38.376095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:54:38.681014 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:54:50.117860 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:54:50.117942 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:54:50.118015 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:54:50.118081 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:54:50.118143 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:54:50.118203 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:54:50.118269 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:54:50.426172 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:55:06.425362 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:55:06.425470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:55:06.425545 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:55:06.425619 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:55:06.425687 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:55:06.425759 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:55:06.425824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:55:06.729327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:55:08.944981 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:55:08.945073 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:55:08.945172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:55:08.945251 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:55:08.945333 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:55:08.945408 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:55:08.945487 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:55:09.250107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:55:36.991404 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:55:36.991508 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:55:36.991580 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:55:36.991652 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:55:36.991730 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:55:36.991798 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:55:36.991871 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:55:37.301388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:55:39.521312 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:55:39.521401 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:55:39.521464 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:55:39.521528 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:55:39.521596 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:55:39.521660 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:55:39.521726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:55:39.828464 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:55:50.239368 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:55:50.239459 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:55:50.239531 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:55:50.239606 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:55:50.239671 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:55:50.239751 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:55:50.239819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:55:50.544578 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:56:07.567187 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:56:07.567271 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:56:07.567343 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:56:07.567439 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:56:07.567507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:56:07.567566 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:56:07.567629 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:56:07.873059 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:56:10.100063 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:56:10.100143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:56:10.100203 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:56:10.100270 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:56:10.100334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:56:10.100397 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:56:10.100457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:56:10.403487 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:56:38.133624 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:56:38.133702 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:56:38.133792 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:56:38.133856 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:56:38.133923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:56:38.133983 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:56:38.134046 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:56:38.436529 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:56:40.665904 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:56:40.666022 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:56:40.666096 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:56:40.666183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:56:40.666254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:56:40.666338 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:56:40.666415 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:56:40.966105 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:56:50.362468 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:56:50.362575 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:56:50.362650 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:56:50.362727 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:56:50.362800 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:56:50.362876 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:56:50.362942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:56:50.670970 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:57:08.692483 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:57:08.692570 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:57:08.692631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:57:08.692704 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:57:08.692779 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:57:08.692855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:57:08.692920 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:57:08.997187 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:57:11.231373 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:57:11.231464 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:57:11.231539 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:57:11.231603 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:57:11.231677 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:57:11.231769 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:57:11.231839 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:57:11.538421 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:57:39.272287 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:57:39.272404 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:57:39.272474 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:57:39.272542 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:57:39.272605 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:57:39.272669 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:57:39.272740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:57:39.574801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:57:41.816026 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:57:41.816110 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:57:41.816175 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:57:41.816240 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:57:41.816304 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:57:41.816366 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:57:41.816427 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:57:42.138000 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:57:50.486365 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:57:50.486451 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:57:50.486525 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:57:50.486584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:57:50.486649 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:57:50.486705 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:57:50.486768 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:57:50.789183 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:58:09.835047 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:58:09.835145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:58:09.835205 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:58:09.835271 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:58:09.835336 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:58:09.835399 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:58:09.835458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:58:10.144056 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:58:12.408114 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:58:12.408208 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:58:12.408279 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:58:12.408351 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:58:12.408410 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:58:12.408477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:58:12.408543 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:58:12.709024 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:58:40.409817 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:58:40.409924 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:58:40.410007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:58:40.410094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:58:40.410180 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:58:40.410270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:58:40.410340 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:58:40.707243 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:58:42.973222 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:58:42.973304 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:58:42.973388 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:58:42.973463 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:58:42.973549 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:58:42.973618 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:58:42.973695 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:58:43.274062 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:58:50.609996 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:58:50.610075 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:58:50.610170 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:58:50.610234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:58:50.610304 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:58:50.610383 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:58:50.610458 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:58:50.909448 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:59:10.968442 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:59:10.968543 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:59:10.968623 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:59:10.968694 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:59:10.968788 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:59:10.968855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:59:10.968931 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:59:11.271379 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:59:13.538092 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:59:13.538181 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:59:13.538268 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:59:13.538341 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:59:13.538419 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:59:13.538486 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:59:13.538558 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:59:13.841184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:59:41.540847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:59:41.540933 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:59:41.541007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:59:41.541074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:59:41.541142 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:59:41.541209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:59:41.541270 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:59:41.847969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:59:44.110283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:59:44.110374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:59:44.110450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:59:44.110513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:59:44.110588 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:59:44.110653 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:59:44.110714 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:59:44.436929 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 08:59:50.748229 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 08:59:50.748312 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 08:59:50.748391 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 08:59:50.748454 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 08:59:50.748518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 08:59:50.748579 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 08:59:50.748646 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 08:59:51.056175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:00:12.113289 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:00:12.113380 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:00:12.113464 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:00:12.113552 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:00:12.113631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:00:12.113704 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:00:12.113791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:00:12.431831 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:00:14.707805 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:00:14.707916 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:00:14.708018 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:00:14.708089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:00:14.708160 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:00:14.708245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:00:14.708314 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:00:15.021282 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:00:42.696942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:00:42.697042 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:00:42.697125 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:00:42.697193 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:00:42.697263 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:00:42.697344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:00:42.697462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:00:42.997533 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:00:45.282108 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:00:45.282211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:00:45.282276 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:00:45.282342 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:00:45.282400 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:00:45.282469 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:00:45.282533 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:00:45.590393 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:00:50.867217 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:00:50.867336 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:00:50.867411 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:00:50.867481 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:00:50.867546 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:00:50.867615 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:00:50.867681 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:00:51.172463 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:01:13.256867 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:01:13.256953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:01:13.257032 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:01:13.257090 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:01:13.257155 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:01:13.257217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:01:13.257278 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:01:13.563053 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:01:15.849791 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:01:15.849870 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:01:15.849938 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:01:15.849997 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:01:15.850058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:01:15.850121 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:01:15.850175 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:01:16.154506 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:01:43.825124 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:01:43.825205 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:01:43.825272 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:01:43.825345 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:01:43.825415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:01:43.825481 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:01:43.825548 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:01:44.140261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:01:46.420301 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:01:46.420381 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:01:46.420456 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:01:46.420526 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:01:46.420588 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:01:46.420652 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:01:46.420712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:01:46.726411 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:01:50.989305 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:01:50.989386 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:01:50.989455 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:01:50.989520 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:01:50.989585 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:01:50.989649 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:01:50.989722 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:01:51.293659 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:02:14.415264 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:02:14.415379 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:02:14.415472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:02:14.415536 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:02:14.415597 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:02:14.415673 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:02:14.415734 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:02:14.723437 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:02:16.982236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:02:16.982319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:02:16.982395 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:02:16.982462 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:02:16.982525 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:02:16.982596 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:02:16.982660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:02:17.287765 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:02:44.984550 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:02:44.984638 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:02:44.984743 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:02:44.984807 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:02:44.984870 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:02:44.984924 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:02:44.984987 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:02:45.294766 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:02:47.547408 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:02:47.547497 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:02:47.547563 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:02:47.547625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:02:47.548945 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:02:47.549551 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:02:47.550233 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:02:47.866064 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:02:51.113013 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:02:51.113090 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:02:51.113156 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:02:51.113224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:02:51.113292 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:02:51.113358 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:02:51.113420 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:02:51.417938 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:03:15.558123 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:03:15.558223 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:03:15.558288 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:03:15.558350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:03:15.558417 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:03:15.558477 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:03:15.558544 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:03:15.862811 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:03:18.135239 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:03:18.135327 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:03:18.135392 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:03:18.135459 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:03:18.135522 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:03:18.135578 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:03:18.135640 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:03:18.448776 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:03:46.127529 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:03:46.127624 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:03:46.127689 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:03:46.127761 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:03:46.127826 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:03:46.127901 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:03:46.127964 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:03:46.428360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:03:48.713390 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:03:48.713471 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:03:48.713563 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:03:48.713627 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:03:48.713686 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:03:48.713762 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:03:48.713826 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:03:49.014337 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:03:51.239403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:03:51.239490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:03:51.239587 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:03:51.239654 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:03:51.239728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:03:51.240189 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:03:51.240669 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:03:51.556900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:04:16.684019 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:04:16.684132 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:04:16.684201 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:04:16.684264 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:04:16.684327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:04:16.684388 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:04:16.684454 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:04:16.997758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:04:19.290011 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:04:19.290128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:04:19.290211 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:04:19.290308 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:04:19.290379 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:04:19.290455 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:04:19.290530 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:04:19.594055 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:04:47.264478 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:04:47.264569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:04:47.264643 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:04:47.264713 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:04:47.264791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:04:47.264865 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:04:47.264934 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:04:47.573034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:04:49.859962 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:04:49.860085 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:04:49.860155 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:04:49.860222 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:04:49.860301 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:04:49.860374 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:04:49.860444 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:04:50.179675 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:04:51.361365 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:04:51.361454 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:04:51.361521 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:04:51.361589 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:04:51.361654 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:04:51.361715 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:04:51.361786 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:04:51.667971 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:05:17.849979 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:05:17.850638 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:05:17.851046 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:05:17.851516 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:05:17.851604 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:05:17.851670 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:05:17.851772 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:05:18.164083 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:05:20.444522 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:05:20.444608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:05:20.444668 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:05:20.444738 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:05:20.444797 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:05:20.444863 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:05:20.444925 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:05:20.751330 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:05:48.428200 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:05:48.428292 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:05:48.428366 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:05:48.428427 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:05:48.428483 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:05:48.428542 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:05:48.428599 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:05:48.738177 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:05:51.012875 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:05:51.012977 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:05:51.013044 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:05:51.013109 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:05:51.013176 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:05:51.013235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:05:51.013296 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:05:51.315585 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:05:51.578836 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:05:51.578919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:05:51.578984 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:05:51.579047 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:05:51.579116 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:05:51.579172 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:05:51.579240 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:05:51.889242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:06:19.003397 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:06:19.003485 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:06:19.003560 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:06:19.003623 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:06:19.003687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:06:19.003759 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:06:19.003832 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:06:19.314418 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:06:21.583819 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:06:21.583907 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:06:21.583981 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:06:21.584094 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:06:21.584166 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:06:21.584251 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:06:21.584322 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:06:21.887657 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:06:49.574269 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:06:49.574368 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:06:49.574448 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:06:49.574518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:06:49.574597 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:06:49.574677 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:06:49.574783 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:06:49.882300 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:06:51.603908 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:06:51.604008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:06:51.604092 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:06:51.604164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:06:51.604233 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:06:51.604306 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:06:51.604371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:06:51.910806 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:06:52.184861 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:06:52.184949 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:06:52.185018 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:06:52.185082 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:06:52.185152 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:06:52.185216 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:06:52.185286 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:06:52.495044 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:07:20.145698 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:07:20.145787 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:07:20.145860 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:07:20.145926 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:07:20.145996 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:07:20.146060 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:07:20.146129 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:07:20.450462 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:07:22.753069 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:07:22.753151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:07:22.753222 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:07:22.753282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:07:22.753350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:07:22.753409 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:07:22.753472 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:07:23.061795 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:07:50.713882 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:07:50.713982 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:07:50.714062 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:07:50.714144 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:07:50.714223 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:07:50.714302 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:07:50.714380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:07:51.022037 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:07:51.731391 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:07:51.731479 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:07:51.731561 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:07:51.731637 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:07:51.731722 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:07:51.731796 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:07:51.731877 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:07:52.074403 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:07:53.323370 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:07:53.323471 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:07:53.323549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:07:53.323624 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:07:53.323693 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:07:53.323770 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:07:53.323844 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:07:53.633517 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:08:21.283977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:08:21.284083 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:08:21.284170 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:08:21.284249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:08:21.284329 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:08:21.284418 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:08:21.284495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:08:21.594747 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:08:23.895901 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:08:23.896012 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:08:23.896101 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:08:23.896180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:08:23.896265 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:08:23.896347 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:08:23.896428 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:08:24.209248 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:08:51.853443 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:08:51.853531 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:08:51.853607 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:08:51.853683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:08:51.853762 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:08:51.853838 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:08:51.853901 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:08:52.171298 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:08:52.439926 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:08:52.440009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:08:52.440078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:08:52.440141 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:08:52.440204 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:08:52.440272 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:08:52.440329 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:08:52.744502 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:08:54.470099 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:08:54.470180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:08:54.470248 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:08:54.470322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:08:54.470388 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:08:54.470455 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:08:54.470511 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:08:54.775310 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:09:22.442045 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:09:22.442154 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:09:22.442222 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:09:22.442282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:09:22.442347 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:09:22.442412 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:09:22.442487 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:09:22.741591 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:09:25.041800 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:09:25.041888 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:09:25.041960 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:09:25.042042 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:09:25.042107 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:09:25.042173 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:09:25.042229 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:09:25.351220 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:09:51.972363 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:09:51.972437 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:09:51.972501 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:09:51.972562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:09:51.972627 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:09:51.973640 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:09:51.974014 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:09:52.307035 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:09:52.999782 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:09:52.999868 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:09:52.999938 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:09:53.000007 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:09:53.000072 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:09:53.000141 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:09:53.000203 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:09:53.309899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:09:55.606226 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:09:55.606322 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:09:55.606392 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:09:55.606457 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:09:55.606524 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:09:55.606589 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:09:55.606655 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:09:55.911796 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:10:23.574372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:10:23.574462 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:10:23.574540 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:10:23.574600 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:10:23.574661 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:10:23.574730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:10:23.574794 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:10:23.874175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:10:26.178058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:10:26.178156 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:10:26.178223 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:10:26.178293 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:10:26.178354 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:10:26.178416 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:10:26.178475 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:10:26.494811 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:10:52.094323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:10:52.094402 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:10:52.094468 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:10:52.094535 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:10:52.094600 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:10:52.094662 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:10:52.094727 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:10:52.408785 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:10:54.135327 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:10:54.135442 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:10:54.135531 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:10:54.135610 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:10:54.135697 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:10:54.135776 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:10:54.135873 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:10:54.444144 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:10:56.756575 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:10:56.756664 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:10:56.756766 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:10:56.756837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:10:56.756902 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:10:56.756966 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:10:56.757024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:10:57.066755 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:11:24.703061 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:11:24.703147 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:11:24.703214 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:11:24.703284 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:11:24.703360 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:11:24.703419 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:11:24.703481 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:11:25.015466 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:11:27.340518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:11:27.340629 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:11:27.340716 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:11:27.340778 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:11:27.340841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:11:27.340913 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:11:27.340975 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:11:27.647916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:11:52.214792 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:11:52.214887 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:11:52.214953 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:11:52.215019 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:11:52.215087 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:11:52.215156 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:11:52.215218 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:11:52.516692 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:11:55.284687 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:11:55.284781 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:11:55.284859 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:11:55.284919 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:11:55.284989 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:11:55.285054 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:11:55.285114 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:11:55.593603 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:11:57.914216 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:11:57.914297 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:11:57.914910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:11:57.915552 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:11:57.915700 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:11:57.915845 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:11:57.915971 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:11:58.224608 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:12:25.852048 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:12:25.852154 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:12:25.852219 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:12:25.852302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:12:25.852368 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:12:25.852435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:12:25.852502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:12:26.156550 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:12:28.488169 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:12:28.488273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:12:28.488355 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:12:28.488443 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:12:28.488523 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:12:28.488603 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:12:28.488678 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:12:28.799082 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:12:52.340679 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:12:52.340808 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:12:52.340887 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:12:52.340975 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:12:52.341051 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:12:52.341142 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:12:52.341223 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:12:52.643326 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:12:56.419107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:12:56.419213 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:12:56.419290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:12:56.419363 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:12:56.419431 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:12:56.419506 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:12:56.419576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:12:56.727262 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:12:59.067365 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:12:59.067449 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:12:59.067520 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:12:59.067583 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:12:59.067649 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:12:59.067713 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:12:59.067784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:12:59.382316 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:13:26.987803 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:13:26.987917 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:13:26.987999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:13:26.988070 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:13:26.988156 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:13:26.988235 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:13:26.988304 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:13:27.287542 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:13:29.650636 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:13:29.650716 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:13:29.650797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:13:29.650861 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:13:29.650928 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:13:29.650988 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:13:29.651051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:13:29.954048 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:13:52.465441 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:13:52.465526 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:13:52.465598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:13:52.465668 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:13:52.465748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:13:52.465815 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:13:52.465890 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:13:52.779359 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:13:57.546824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:13:57.546920 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:13:57.546992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:13:57.547057 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:13:57.547121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:13:57.547187 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:13:57.547257 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:13:57.851844 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:14:00.216034 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:14:00.216121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:14:00.216185 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:14:00.216250 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:14:00.216318 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:14:00.216379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:14:00.216442 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:14:00.517455 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:14:28.116061 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:14:28.116148 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:14:28.116214 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:14:28.116283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:14:28.116343 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:14:28.116405 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:14:28.116470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:14:28.425738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:14:30.782530 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:14:30.782621 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:14:30.782692 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:14:30.782777 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:14:30.782847 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:14:30.782907 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:14:30.783923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:14:31.088061 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:14:52.592166 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:14:52.592245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:14:52.592314 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:14:52.592381 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:14:52.592442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:14:52.592503 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:14:52.592571 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:14:52.900363 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:14:58.685495 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:14:58.685579 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:14:58.685654 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:14:58.685725 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:14:58.685806 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:14:58.685874 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:14:58.685943 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:14:58.994800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:15:01.344481 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:15:01.344574 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:15:01.344646 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:15:01.344727 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:15:01.344792 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:15:01.344865 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:15:01.344933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:15:01.653338 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:15:29.275032 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:15:29.275119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:15:29.275190 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:15:29.275263 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:15:29.275328 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:15:29.275405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:15:29.275476 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:15:29.581125 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:15:31.922391 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:15:31.922476 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:15:31.922541 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:15:31.922614 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:15:31.922677 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:15:31.922756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:15:31.922816 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:15:32.243698 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:15:52.680881 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:15:52.680971 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:15:52.681030 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:15:52.681086 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:15:52.681149 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:15:52.681207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:15:52.681270 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:15:52.994869 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:15:59.844862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:15:59.844942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:15:59.845017 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:15:59.845081 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:15:59.845143 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:15:59.845203 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:15:59.845267 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:16:00.157130 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:16:02.513678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:16:02.513768 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:16:02.513844 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:16:02.513922 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:16:02.513987 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:16:02.514046 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:16:02.514111 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:16:02.816620 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:16:30.418497 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:16:30.418585 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:16:30.418652 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:16:30.418715 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:16:30.418776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:16:30.418844 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:16:30.418911 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:16:30.729105 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:16:33.082353 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:16:33.082456 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:16:33.082522 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:16:33.082594 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:16:33.082663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:16:33.082732 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:16:33.082801 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:16:33.388432 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:16:52.813959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:16:52.814049 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:16:52.814139 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:16:52.814246 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:16:52.814328 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:16:52.814409 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:16:52.814491 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:16:53.123634 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:17:00.993476 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:17:00.993596 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:17:00.993680 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:17:00.993765 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:17:00.993850 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:17:00.993926 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:17:00.994011 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:17:01.302851 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:17:03.646785 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:17:03.646884 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:17:03.646959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:17:03.647035 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:17:03.647113 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:17:03.647189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:17:03.647264 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:17:03.956075 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:17:31.561424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:17:31.561518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:17:31.561595 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:17:31.561663 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:17:31.561730 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:17:31.561790 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:17:31.561849 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:17:31.880346 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:17:34.240439 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:17:34.240520 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:17:34.240587 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:17:34.240649 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:17:34.240714 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:17:34.240778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:17:34.240843 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:17:34.547988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:17:52.942910 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:17:52.943004 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:17:52.943078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:17:52.943136 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:17:52.943237 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:17:52.943304 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:17:52.943370 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:17:53.257928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:18:02.157072 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:18:02.157159 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:18:02.157228 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:18:02.157305 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:18:02.157370 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:18:02.157439 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:18:02.157507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:18:02.464156 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:18:04.807390 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:18:04.807473 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:18:04.807549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:18:04.807607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:18:04.807680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:18:04.807753 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:18:04.807816 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:18:05.118259 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:18:32.727025 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:18:32.727114 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:18:32.727177 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:18:32.727243 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:18:32.727314 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:18:32.727378 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:18:32.727437 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:18:33.029633 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:18:35.388324 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:18:35.388412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:18:35.388482 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:18:35.388545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:18:35.388606 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:18:35.388671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:18:35.388747 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:18:35.690379 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:18:53.079535 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:18:53.079620 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:18:53.079684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:18:53.079765 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:18:53.079834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:18:53.079898 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:18:53.079958 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:18:53.396580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:19:03.292447 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:19:03.292551 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:19:03.292622 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:19:03.292683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:19:03.292751 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:19:03.292807 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:19:03.293567 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:19:03.599468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:19:05.949291 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:19:05.949407 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:19:05.949471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:19:05.949535 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:19:05.949598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:19:05.949658 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:19:05.949724 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:19:06.250684 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:19:33.859591 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:19:33.859686 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:19:33.859762 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:19:33.859832 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:19:33.859897 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:19:33.859963 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:19:33.860023 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:19:34.165890 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:19:36.514890 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:19:36.514971 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:19:36.515039 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:19:36.515113 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:19:36.515173 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:19:36.515240 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:19:36.515297 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:19:36.823874 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:19:53.206211 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:19:53.206293 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:19:53.206359 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:19:53.206426 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:19:53.206489 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:19:53.206556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:19:53.206615 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:19:53.514876 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:20:04.431728 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:20:04.431805 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:20:04.431876 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:20:04.431948 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:20:04.432009 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:20:04.432066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:20:04.432130 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:20:04.740388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:20:07.079305 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:20:07.079401 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:20:07.079513 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:20:07.079600 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:20:07.079710 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:20:07.079811 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:20:07.079903 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:20:07.376938 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:20:35.008312 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:20:35.008414 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:20:35.008483 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:20:35.008552 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:20:35.008635 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:20:35.008698 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:20:35.008774 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:20:35.313668 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:20:37.634502 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:20:37.634598 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:20:37.634663 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:20:37.634728 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:20:37.634799 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:20:37.634863 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:20:37.634923 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:20:37.939379 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:20:53.334203 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:20:53.334287 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:20:53.334352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:20:53.334433 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:20:53.334499 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:20:53.334562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:20:53.334622 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:20:53.644161 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:21:05.578370 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:21:05.578462 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:21:05.578523 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:21:05.578600 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:21:05.578661 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:21:05.578731 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:21:05.578794 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:21:05.884447 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:21:08.199101 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:21:08.199188 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:21:08.199273 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:21:08.199332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:21:08.199393 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:21:08.199457 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:21:08.199515 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:21:08.515252 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:21:36.148528 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:21:36.148616 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:21:36.148730 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:21:36.148828 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:21:36.148914 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:21:36.148991 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:21:36.149074 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:21:36.457188 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:21:38.778286 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:21:38.778371 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:21:38.778446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:21:38.778520 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:21:38.778584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:21:38.778644 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:21:38.778704 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:21:39.081833 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:21:53.458411 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:21:53.458496 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:21:53.458562 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:21:53.458647 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:21:53.458706 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:21:53.458771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:21:53.458837 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:21:53.767970 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:22:06.724022 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:22:06.724117 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:22:06.724182 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:22:06.724241 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:22:06.724307 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:22:06.724370 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:22:06.724433 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:22:07.030232 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:22:09.343001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:22:09.343088 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:22:09.343160 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:22:09.343228 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:22:09.343298 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:22:09.343363 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:22:09.343436 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:22:09.649465 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:22:37.291109 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:22:37.291202 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:22:37.291259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:22:37.291346 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:22:37.291409 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:22:37.291470 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:22:37.291540 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:22:37.611977 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:22:39.915754 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:22:39.915859 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:22:39.915931 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:22:39.915999 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:22:39.916064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:22:39.916137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:22:39.916226 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:22:40.235798 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:22:53.589671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:22:53.589757 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:22:53.589836 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:22:53.589899 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:22:53.589965 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:22:53.590028 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:22:53.590090 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:22:53.892768 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:23:07.878019 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:23:07.878124 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:23:07.878183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:23:07.878242 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:23:07.878309 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:23:07.878367 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:23:07.878428 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:23:08.192914 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:23:10.495341 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:23:10.495426 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:23:10.495487 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:23:10.495553 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:23:10.495615 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:23:10.495678 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:23:10.495750 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:23:10.807759 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:23:38.460984 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:23:38.461067 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:23:38.461143 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:23:38.461208 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:23:38.461268 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:23:38.461327 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:23:38.461392 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:23:38.770889 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:23:41.079517 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:23:41.079600 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:23:41.079666 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:23:41.079739 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:23:41.079801 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:23:41.079869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:23:41.079933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:23:41.395929 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:23:53.718654 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:23:53.718782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:23:53.718863 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:23:53.718937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:23:53.719020 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:23:53.719093 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:23:53.719173 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:23:54.030786 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:24:09.031413 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:24:09.031538 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:24:09.031609 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:24:09.031684 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:24:09.031763 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:24:09.031839 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:24:09.031911 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:24:09.347997 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:24:11.669890 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:24:11.670000 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:24:11.670067 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:24:11.670131 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:24:11.670193 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:24:11.670255 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:24:11.670312 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:24:11.976067 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:24:39.606885 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:24:39.606970 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:24:39.607041 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:24:39.607105 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:24:39.607173 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:24:39.607239 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:24:39.607301 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:24:39.913518 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:24:42.310580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:24:42.310665 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:24:42.310742 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:24:42.310817 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:24:42.310891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:24:42.310955 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:24:42.311024 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:24:42.628545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:24:53.846811 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:24:53.846923 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:24:53.847036 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:24:53.847117 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:24:53.847199 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:24:53.847276 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:24:53.847357 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:24:54.147735 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:25:10.180018 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:25:10.180107 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:25:10.180182 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:25:10.180252 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:25:10.180327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:25:10.180395 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:25:10.180465 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:25:10.488770 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:25:12.897214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:25:12.897312 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:25:12.897396 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:25:12.897480 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:25:12.897565 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:25:12.897636 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:25:12.897713 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:25:13.209957 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:25:40.757375 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:25:40.757471 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:25:40.757555 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:25:40.757628 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:25:40.757705 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:25:40.757786 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:25:40.757859 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:25:41.062877 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:25:43.466099 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:25:43.466217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:25:43.466289 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:25:43.466371 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:25:43.466447 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:25:43.466528 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:25:43.466616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:25:43.777257 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:25:53.970127 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:25:53.970224 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:25:53.970294 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:25:53.970375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:25:53.970441 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:25:53.970519 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:25:53.970586 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:25:54.284086 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:26:11.331200 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:26:11.331293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:26:11.331366 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:26:11.331435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:26:11.331510 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:26:11.331582 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:26:11.331679 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:26:11.638376 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:26:14.043841 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:26:14.043925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:26:14.044008 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:26:14.044077 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:26:14.044149 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:26:14.044209 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:26:14.044275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:26:14.354936 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:26:41.899699 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:26:41.899811 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:26:41.899879 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:26:41.899945 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:26:41.900008 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:26:41.900074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:26:41.900137 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:26:42.222164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:26:44.615652 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:26:44.615742 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:26:44.615818 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:26:44.615884 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:26:44.615947 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:26:44.616009 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:26:44.616066 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:26:44.920766 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:26:54.098841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:26:54.098921 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:26:54.098991 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:26:54.099058 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:26:54.099122 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:26:54.099188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:26:54.099256 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:26:54.410298 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:27:12.486186 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:27:12.486302 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:27:12.486387 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:27:12.486470 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:27:12.486540 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:27:12.486617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:27:12.486695 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:27:12.790281 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:27:15.183386 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:27:15.183475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:27:15.183560 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:27:15.183644 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:27:15.183725 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:27:15.183802 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:27:15.183874 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:27:15.489735 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:27:43.056192 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:27:43.056279 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:27:43.056350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:27:43.056418 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:27:43.056495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:27:43.056562 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:27:43.056626 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:27:43.364933 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:27:45.748437 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:27:45.748547 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:27:45.748629 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:27:45.748707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:27:45.748806 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:27:45.748894 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:27:45.748969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:27:46.056454 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:27:54.231002 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:27:54.231098 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:27:54.231167 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:27:54.231239 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:27:54.231320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:27:54.231387 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:27:54.231462 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:27:54.539194 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:28:13.632861 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:28:13.632975 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:28:13.633070 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:28:13.633163 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:28:13.633250 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:28:13.633332 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:28:13.633418 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:28:13.938908 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:28:16.316347 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:28:16.316445 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:28:16.316522 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:28:16.316609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:28:16.316691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:28:16.316771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:28:16.316845 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:28:16.621363 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:28:44.204033 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:28:44.204131 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:28:44.204197 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:28:44.204264 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:28:44.204323 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:28:44.204387 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:28:44.204469 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:28:44.515628 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:28:46.885569 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:28:46.885650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:28:46.885726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:28:46.885806 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:28:46.885875 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:28:46.885938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:28:46.886002 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:28:47.199940 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:28:54.354631 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:28:54.354723 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:28:54.354791 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:28:54.354855 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:28:54.354920 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:28:54.354990 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:28:54.355048 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:28:54.664714 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:29:14.780777 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:29:14.780856 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:29:14.780959 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:29:14.781020 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:29:14.781080 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:29:14.781141 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:29:14.781210 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:29:15.088989 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:29:17.461445 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:29:17.461523 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:29:17.461589 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:29:17.461654 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:29:17.461722 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:29:17.461783 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:29:17.461852 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:29:17.771765 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:29:45.347902 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:29:45.348061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:29:45.348197 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:29:45.348337 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:29:45.348724 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:29:45.349638 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:29:45.349751 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:29:45.662869 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:29:48.041957 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:29:48.042046 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:29:48.042114 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:29:48.042185 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:29:48.042251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:29:48.042316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:29:48.042395 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:29:48.350960 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:29:54.481891 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:29:54.481965 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:29:54.482047 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:29:54.482126 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:29:54.482196 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:29:54.482258 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:29:54.482330 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:29:54.789539 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:30:15.932189 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:30:15.932276 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:30:15.932348 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:30:15.932411 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:30:15.932469 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:30:15.932534 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:30:15.932593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:30:16.239571 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:30:18.618692 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:30:18.618780 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:30:18.618852 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:30:18.618914 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:30:18.618976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:30:18.619037 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:30:18.619107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:30:18.917327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:30:46.504602 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:30:46.504701 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:30:46.504777 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:30:46.504849 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:30:46.504915 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:30:46.504973 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:30:46.505038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:30:46.821080 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:30:49.179011 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:30:49.179088 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:30:49.179158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:30:49.179232 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:30:49.179300 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:30:49.179363 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:30:49.179430 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:30:49.485085 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:30:54.609923 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:30:54.610003 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:30:54.610081 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:30:54.610144 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:30:54.610210 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:30:54.610276 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:30:54.610343 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:30:54.920642 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:31:17.088992 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:31:17.089082 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:31:17.089147 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:31:17.089213 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:31:17.089270 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:31:17.089340 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:31:17.089404 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:31:17.404338 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:31:19.746698 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:31:19.746786 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:31:19.746851 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:31:19.746921 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:31:19.746984 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:31:19.747056 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:31:19.747119 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:31:20.072137 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:31:47.665317 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:31:47.665417 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:31:47.665481 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:31:47.665551 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:31:47.665621 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:31:47.665684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:31:47.665750 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:31:47.975951 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:31:50.338502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:31:50.338594 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:31:50.338679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:31:50.338782 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:31:50.338851 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:31:50.338937 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:31:50.339011 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:31:50.649802 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:31:54.734970 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:31:54.735052 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:31:54.735117 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:31:54.735182 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:31:54.735243 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:31:54.735306 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:31:54.735372 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:31:55.040589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:32:18.242154 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:32:18.242232 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:32:18.242316 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:32:18.242377 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:32:18.242440 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:32:18.242499 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:32:18.242564 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:32:18.549074 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:32:20.914765 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:32:20.914846 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:32:20.914911 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:32:20.914988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:32:20.915058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:32:20.915125 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:32:20.915187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:32:21.220262 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:32:48.807131 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:32:48.807252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:32:48.807318 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:32:48.807390 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:32:48.807449 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:32:48.807508 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:32:48.807571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:32:49.117932 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:32:51.489127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:32:51.489211 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:32:51.489282 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:32:51.489351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:32:51.489410 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:32:51.489474 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:32:51.489555 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:32:51.807998 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:32:54.866524 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:32:54.866608 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:32:54.866693 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:32:54.866771 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:32:54.866842 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:32:54.866912 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:32:54.866973 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:32:55.184995 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:33:19.395746 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:33:19.395831 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:33:19.395903 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:33:19.395970 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:33:19.396038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:33:19.396097 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:33:19.396166 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:33:19.706600 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:33:22.092354 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:33:22.092438 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:33:22.092515 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:33:22.092581 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:33:22.092647 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:33:22.092713 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:33:22.092783 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:33:22.407221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:33:49.976434 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:33:49.976525 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:33:49.976595 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:33:49.976648 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:33:49.976722 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:33:49.976785 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:33:49.976855 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:33:50.288150 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:33:52.668597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:33:52.668681 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:33:52.668764 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:33:52.668833 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:33:52.668899 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:33:52.668956 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:33:52.669026 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:33:52.976191 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:33:54.996110 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:33:54.996193 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:33:54.996269 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:33:54.996331 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:33:54.996399 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:33:54.996457 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:33:54.996519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:33:55.311467 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:34:20.557346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:34:20.557463 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:34:20.557537 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:34:20.557627 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:34:20.557711 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:34:20.557800 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:34:20.557873 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:34:20.858701 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:34:23.241050 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:34:23.241167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:34:23.241242 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:34:23.241316 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:34:23.241388 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:34:23.241457 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:34:23.241530 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:34:23.539410 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:34:51.120762 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:34:51.120848 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:34:51.120918 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:34:51.120985 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:34:51.121049 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:34:51.121114 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:34:51.121178 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:34:51.421658 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:34:53.790825 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:34:53.790908 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:34:53.790972 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:34:53.791049 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:34:53.791118 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:34:53.791183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:34:53.791244 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:34:54.101973 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:34:55.123697 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:34:55.123787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:34:55.123852 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:34:55.123925 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:34:55.123998 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:34:55.124073 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:34:55.124132 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:34:55.430276 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:35:21.679259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:35:21.680298 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:35:21.680523 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:35:21.680830 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:35:21.681385 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:35:21.682316 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:35:21.682422 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:35:21.983862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:35:24.372873 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:35:24.372985 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:35:24.373054 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:35:24.373118 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:35:24.373187 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:35:24.373247 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:35:24.373309 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:35:24.686723 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:35:52.266168 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:35:52.266267 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:35:52.266332 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:35:52.266402 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:35:52.266468 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:35:52.266533 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:35:52.266595 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:35:52.575101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:35:54.946791 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:35:54.946877 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:35:54.946943 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:35:54.947009 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:35:54.947080 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:35:54.947146 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:35:54.947211 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:35:55.266320 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:35:55.532837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:35:55.532930 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:35:55.532996 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:35:55.533064 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:35:55.533130 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:35:55.533197 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:35:55.533259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:35:55.838300 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:36:22.842352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:36:22.842439 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:36:22.842516 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:36:22.842580 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:36:22.842640 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:36:22.842708 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:36:22.842774 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:36:23.144819 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:36:25.533590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:36:25.533695 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:36:25.533762 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:36:25.533825 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:36:25.533886 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:36:25.533952 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:36:25.534010 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:36:25.839820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:36:53.407323 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:36:53.407407 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:36:53.407474 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:36:53.407536 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:36:53.407604 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:36:53.407663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:36:53.407727 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:36:53.717450 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:36:55.379960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:36:55.380052 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:36:55.380117 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:36:55.380184 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:36:55.380249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:36:55.380309 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:36:55.380376 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:36:55.686867 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:36:56.098341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:36:56.098452 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:36:56.098532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:36:56.098603 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:36:56.098688 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:36:56.098778 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:36:56.098860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:36:56.401141 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:37:23.976859 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:37:23.976954 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:37:23.977035 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:37:23.977120 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:37:23.977205 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:37:23.977285 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:37:23.977357 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:37:24.287114 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:37:26.657627 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:37:26.657754 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:37:26.657835 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:37:26.657912 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:37:26.658001 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:37:26.658082 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:37:26.658159 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:37:26.969218 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:37:54.545765 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:37:54.545858 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:37:54.545924 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:37:54.545991 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:37:54.546062 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:37:54.546141 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:37:54.546203 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:37:54.849287 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:37:55.511638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:37:55.511726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:37:55.511797 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:37:55.511863 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:37:55.511935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:37:55.512003 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:37:55.512071 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:37:55.822310 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:37:57.235519 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:37:57.235619 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:37:57.235709 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:37:57.235801 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:37:57.235886 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:37:57.235959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:37:57.236032 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:37:57.547917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:38:25.129072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:38:25.129188 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:38:25.129261 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:38:25.129337 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:38:25.129421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:38:25.129497 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:38:25.129571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:38:25.436714 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:38:27.811933 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:38:27.812025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:38:27.812095 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:38:27.812169 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:38:27.812236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:38:27.812299 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:38:27.812374 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:38:28.116392 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:38:55.640171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:38:55.640264 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:38:55.640328 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:38:55.640399 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:38:55.640466 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:38:55.640532 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:38:55.640593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:38:55.945243 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:38:56.203885 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:38:56.203964 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:38:56.204027 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:38:56.204087 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:38:56.204150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:38:56.204220 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:38:56.204280 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:38:56.507389 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:38:58.384358 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:38:58.384439 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:38:58.384508 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:38:58.384571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:38:58.384636 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:38:58.384695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:38:58.384764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:38:58.692880 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:39:26.205966 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:39:26.206054 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:39:26.206125 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:39:26.206195 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:39:26.206260 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:39:26.206326 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:39:26.206396 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:39:26.515711 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:39:28.957400 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:39:28.957483 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:39:28.957555 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:39:28.957619 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:39:28.957678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:39:28.957746 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:39:28.957811 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:39:29.263883 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:39:55.778075 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:39:55.778188 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:39:55.778271 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:39:55.778338 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:39:55.778415 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:39:55.778491 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:39:55.778560 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:39:56.093255 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:39:56.773991 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:39:56.774077 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:39:56.774138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:39:56.774198 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:39:56.774257 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:39:56.774315 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:39:56.774377 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:39:57.072779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:39:59.526628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:39:59.526729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:39:59.526829 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:39:59.526904 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:39:59.526983 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:39:59.527060 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:39:59.527139 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:39:59.835176 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:40:27.335183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:40:27.335297 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:40:27.335375 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:40:27.335444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:40:27.335521 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:40:27.335587 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:40:27.335658 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:40:27.643189 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:40:30.094074 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:40:30.094165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:40:30.094231 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:40:30.094295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:40:30.094359 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:40:30.094425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:40:30.094500 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:40:30.412176 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:40:55.904908 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:40:55.904985 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:40:55.905058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:40:55.905115 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:40:55.905194 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:40:55.905258 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:40:55.905321 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:40:56.211601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:40:57.904861 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:40:57.904965 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:40:57.905040 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:40:57.905108 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:40:57.905176 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:40:57.905250 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:40:57.905320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:40:58.213619 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:41:00.674286 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:41:00.674376 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:41:00.674444 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:41:00.674509 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:41:00.674574 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:41:00.674637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:41:00.674699 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:41:00.978997 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:41:28.474164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:41:28.474248 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:41:28.474320 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:41:28.474390 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:41:28.474455 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:41:28.474523 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:41:28.474585 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:41:28.782259 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:41:31.245674 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:41:31.245764 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:41:31.245832 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:41:31.245896 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:41:31.245954 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:41:31.246014 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:41:31.246077 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:41:31.551899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:41:56.034565 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:41:56.034651 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:41:56.034722 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:41:56.034784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:41:56.034847 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:41:56.034910 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:41:56.034982 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:41:56.340181 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:41:59.047678 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:41:59.047773 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:41:59.047844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:41:59.047918 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:41:59.047979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:41:59.048047 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:41:59.048105 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:41:59.348104 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:42:01.830333 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:42:01.830426 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:42:01.830505 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:42:01.830578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:42:01.830645 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:42:01.831458 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:42:01.831897 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:42:02.160222 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:42:29.616225 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:42:29.616325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:42:29.616403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:42:29.616481 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:42:29.616565 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:42:29.616641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:42:29.616727 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:42:29.926775 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:42:32.423448 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:42:32.423542 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:42:32.423615 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:42:32.423715 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:42:32.423796 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:42:32.423866 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:42:32.423943 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:42:32.723749 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:42:56.165887 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:42:56.165976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:42:56.166071 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:42:56.166147 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:42:56.166231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:42:56.166312 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:42:56.166388 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:42:56.470068 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:43:00.200047 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:43:00.200149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:43:00.200234 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:43:00.200313 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:43:00.200408 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:43:00.200491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:43:00.200576 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:43:00.504843 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:43:02.980762 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:43:02.980888 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:43:02.980967 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:43:02.981054 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:43:02.981128 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:43:02.981208 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:43:02.981289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:43:03.284380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:43:30.764021 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:43:30.764134 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:43:30.764224 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:43:30.764323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:43:30.764398 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:43:30.764478 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:43:30.764548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:43:31.066270 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:43:33.549051 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:43:33.549144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:43:33.549220 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:43:33.549290 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:43:33.549358 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:43:33.549432 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:43:33.549504 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:43:33.858195 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:43:56.290530 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:43:56.290610 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:43:56.290678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:43:56.290751 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:43:56.290818 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:43:56.290884 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:43:56.290942 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:43:56.601568 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:44:01.322916 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:44:01.322999 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:44:01.323079 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:44:01.323141 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:44:01.323218 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:44:01.323282 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:44:01.323353 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:44:01.626578 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:44:04.118048 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:44:04.118132 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:44:04.118201 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:44:04.118267 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:44:04.118331 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:44:04.118400 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:44:04.118462 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:44:04.432079 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:44:31.900038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:44:31.900129 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:44:31.900212 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:44:31.900275 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:44:31.900332 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:44:31.900396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:44:31.900451 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:44:32.228549 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:44:34.699781 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:44:34.700198 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:44:34.700904 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:44:34.701157 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:44:34.701307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:44:34.701826 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:44:34.701926 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:44:35.020063 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:44:56.412596 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:44:56.412697 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:44:56.412789 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:44:56.412872 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:44:56.412950 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:44:56.413042 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:44:56.413131 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:44:56.715318 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:45:02.489553 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:45:02.489662 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:45:02.489769 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:45:02.489864 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:45:02.489960 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:45:02.490045 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:45:02.490135 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:45:02.809393 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:45:05.282014 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:45:05.282126 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:45:05.282208 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:45:05.282297 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:45:05.282382 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:45:05.282461 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:45:05.282542 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:45:05.588050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:45:33.076598 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:45:33.076696 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:45:33.076792 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:45:33.076866 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:45:33.076953 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:45:33.077036 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:45:33.077112 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:45:33.385880 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:45:35.850153 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:45:35.850270 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:45:35.850343 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:45:35.850418 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:45:35.850502 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:45:35.850586 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:45:35.850656 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:45:36.153244 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:45:56.531253 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:45:56.531342 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:45:56.531412 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:45:56.531494 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:45:56.531560 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:45:56.531632 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:45:56.531698 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:45:56.833274 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:46:03.643813 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:46:03.643928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:46:03.644008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:46:03.644086 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:46:03.644163 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:46:03.644250 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:46:03.644329 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:46:03.949331 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:46:06.411858 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:46:06.411980 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:46:06.412056 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:46:06.412138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:46:06.412217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:46:06.412297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:46:06.412391 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:46:06.718306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:46:34.220247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:46:34.220357 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:46:34.220435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:46:34.220511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:46:34.220583 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:46:34.220658 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:46:34.220737 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:46:34.524845 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:46:36.979146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:46:36.979229 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:46:36.979302 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:46:36.979364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:46:36.979429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:46:36.979498 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:46:36.979562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:46:37.278216 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:46:56.647734 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:46:56.647898 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:46:56.647989 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:46:56.648066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:46:56.648145 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:46:56.648223 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:46:56.648321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:46:56.963970 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:47:04.784518 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:47:04.784624 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:47:04.784691 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:47:04.784770 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:47:04.784844 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:47:04.784922 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:47:04.784994 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:47:05.095631 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:47:07.541569 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:47:07.541693 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:47:07.541761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:47:07.541834 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:47:07.541912 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:47:07.541980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:47:07.542039 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:47:07.840863 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:47:35.363531 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:47:35.363652 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:47:35.363716 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:47:35.363784 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:47:35.363849 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:47:35.363911 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:47:35.363977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:47:35.664689 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:47:38.103088 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:47:38.103211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:47:38.103292 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:47:38.103371 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:47:38.103447 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:47:38.103528 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:47:38.103600 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:47:38.405496 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:47:56.772606 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:47:56.772702 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:47:56.772794 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:47:56.772863 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:47:56.772948 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:47:56.773024 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:47:56.773101 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:47:57.083321 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:48:05.924414 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:48:05.924494 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:48:05.924565 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:48:05.924632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:48:05.924709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:48:05.924798 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:48:05.924868 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:48:06.232451 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:48:08.670703 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:48:08.670811 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:48:08.670874 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:48:08.670935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:48:08.670998 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:48:08.671063 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:48:08.671122 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:48:08.973638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:48:36.504697 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:48:36.504794 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:48:36.504862 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:48:36.504923 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:48:36.504987 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:48:36.505050 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:48:36.505111 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:48:36.818798 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:48:39.241731 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:48:39.241849 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:48:39.241912 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:48:39.241975 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:48:39.242030 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:48:39.242092 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:48:39.242159 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:48:39.548080 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:48:56.893709 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:48:56.893805 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:48:56.893906 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:48:56.893997 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:48:56.894097 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:48:56.894180 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:48:56.894282 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:48:57.205831 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:49:07.077917 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:49:07.078024 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:49:07.078109 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:49:07.078187 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:49:07.079291 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:49:07.079516 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:49:07.079681 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:49:07.380284 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:49:09.810323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:49:09.810423 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:49:09.810491 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:49:09.810568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:49:09.810631 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:49:09.810696 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:49:09.810766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:49:10.124568 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:49:37.636502 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:49:37.636590 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:49:37.636666 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:49:37.636732 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:49:37.636799 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:49:37.636877 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:49:37.636945 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:49:37.953309 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:49:40.393317 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:49:40.393409 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:49:40.393472 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:49:40.393541 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:49:40.393617 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:49:40.393694 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:49:40.393771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:49:40.715342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:49:57.017061 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:49:57.017154 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:49:57.017214 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:49:57.017290 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:49:57.017353 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:49:57.017426 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:49:57.017501 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:49:57.328215 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:50:08.223864 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:50:08.223949 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:50:08.224020 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:50:08.224095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:50:08.224166 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:50:08.224230 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:50:08.224295 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:50:08.532242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:50:10.985727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:50:10.985825 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:50:10.985904 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:50:10.985985 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:50:10.986065 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:50:10.986152 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:50:10.986237 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:50:11.290776 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:50:38.792956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:50:38.793041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:50:38.793111 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:50:38.793184 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:50:38.793250 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:50:38.793316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:50:38.793389 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:50:39.101381 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 09:50:41.550404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:50:41.550528 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:50:41.550622 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:50:41.550733 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:50:41.550821 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:50:41.550911 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:50:41.550992 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:50:41.855784 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 09:50:57.135712 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:50:57.135820 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:50:57.135900 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:50:57.135973 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:50:57.136038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:50:57.136111 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:50:57.136182 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:50:57.444434 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 09:51:09.375135 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:51:09.375226 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:51:09.375291 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:51:09.375357 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:51:09.375427 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:51:09.375482 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:51:09.375547 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:51:09.685061 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:51:12.130695 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:51:12.130793 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:51:12.130875 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:51:12.130938 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:51:12.131000 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:51:12.131064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:51:12.131131 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:51:12.439244 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:51:39.948841 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:51:39.949905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:51:39.951002 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:51:39.951467 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:51:39.951624 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:51:39.952386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:51:39.952511 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:51:40.266472 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:51:42.696484 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:51:42.696597 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:51:42.696676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:51:42.696766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:51:42.696845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:51:42.696927 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:51:42.696999 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:51:42.998745 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:51:57.255680 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:51:57.255794 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:51:57.255891 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:51:57.255972 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:51:57.256046 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:51:57.256116 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:51:57.256191 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:51:57.567254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:52:10.534709 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:52:10.534797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:52:10.534869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:52:10.534946 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:52:10.535019 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:52:10.535078 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:52:10.535150 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:52:10.839581 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:52:13.262815 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:52:13.262912 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:52:13.262983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:52:13.263048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:52:13.263107 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:52:13.263165 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:52:13.263240 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:52:13.575677 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:52:41.100462 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:52:41.100543 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:52:41.100611 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:52:41.100679 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:52:41.100750 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:52:41.100819 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:52:41.100894 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:52:41.408211 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:52:43.843542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:52:43.843641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:52:43.843770 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:52:43.843850 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:52:43.843912 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:52:43.843977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:52:43.844047 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:52:44.161227 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:52:57.382561 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:52:57.382647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:52:57.382730 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:52:57.382801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:52:57.382875 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:52:57.382941 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:52:57.383008 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:52:57.692542 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:53:11.671981 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:53:11.672087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:53:11.672163 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:53:11.672231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:53:11.672317 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:53:11.672391 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:53:11.672465 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:53:11.971109 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:53:14.425201 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:53:14.425301 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:53:14.425376 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:53:14.425464 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:53:14.425545 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:53:14.425624 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:53:14.425706 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:53:14.730901 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:53:42.263621 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:53:42.263735 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:53:42.263816 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:53:42.263888 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:53:42.263957 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:53:42.264025 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:53:42.264101 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:53:42.569576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:53:44.990170 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:53:44.990288 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:53:44.990373 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:53:44.990453 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:53:44.990537 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:53:44.990614 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:53:44.990716 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:53:45.290541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:53:57.505610 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:53:57.505696 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:53:57.505775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:53:57.505845 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:53:57.505918 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:53:57.505990 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:53:57.506060 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:53:57.810033 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:54:12.835539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:54:12.835654 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:54:12.835724 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:54:12.835795 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:54:12.835853 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:54:12.835915 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:54:12.835972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:54:13.144003 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:54:15.557158 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:54:15.557276 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:54:15.557368 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:54:15.557439 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:54:15.557525 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:54:15.557602 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:54:15.557692 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:54:15.860975 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:54:43.407118 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:54:43.407224 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:54:43.407297 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:54:43.407370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:54:43.407445 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:54:43.407525 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:54:43.407577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:54:43.707987 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:54:46.120175 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:54:46.120273 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:54:46.120339 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:54:46.120405 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:54:46.120464 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:54:46.120528 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:54:46.120587 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:54:46.420423 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:54:57.625452 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:54:57.625600 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:54:57.625680 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:54:57.625803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:54:57.625898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:54:57.625970 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:54:57.626059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:54:57.923607 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:55:13.971477 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:55:13.971565 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:55:13.971644 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:55:13.971714 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:55:13.971795 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:55:13.971867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:55:13.971942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:55:14.282933 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:55:16.678125 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:55:16.678217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:55:16.678283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:55:16.678346 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:55:16.678413 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:55:16.678475 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:55:16.678539 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:55:16.982868 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:55:44.545162 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:55:44.545273 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:55:44.545368 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:55:44.545450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:55:44.545525 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:55:44.545600 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:55:44.545668 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:55:44.845457 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:55:47.243208 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:55:47.243305 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:55:47.243389 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:55:47.243466 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:55:47.243533 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:55:47.243605 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:55:47.243673 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:55:47.549959 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:55:57.738814 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:55:57.738902 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:55:57.738971 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:55:57.739036 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:55:57.739095 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:55:57.739166 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:55:57.739227 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:55:58.043051 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:56:15.104864 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:56:15.104951 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:56:15.105021 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:56:15.105080 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:56:15.105172 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:56:15.105238 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:56:15.105309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:56:15.410699 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:56:17.825544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:56:17.825627 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:56:17.825694 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:56:17.825771 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:56:17.825839 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:56:17.825902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:56:17.825969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:56:18.125497 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:56:45.667363 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:56:45.667445 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:56:45.667549 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:56:45.667614 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:56:45.667686 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:56:45.667766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:56:45.667843 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:56:45.973593 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:56:48.389452 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:56:48.389576 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:56:48.389651 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:56:48.389725 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:56:48.389819 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:56:48.389895 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:56:48.389958 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:56:48.689767 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:56:57.854983 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:56:57.855069 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:56:57.855136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:56:57.855214 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:56:57.855287 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:56:57.855372 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:56:57.855441 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:56:58.159836 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:57:16.233193 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:57:16.233604 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:57:16.234296 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:57:16.235005 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:57:16.235106 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:57:16.235241 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:57:16.235336 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:57:16.536102 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:57:18.957459 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:57:18.957571 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:57:18.957674 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:57:18.957764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:57:18.957854 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:57:18.957941 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:57:18.958024 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:57:19.263984 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:57:46.792132 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:57:46.792217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:57:46.792291 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:57:46.792361 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:57:46.792429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:57:46.792496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:57:46.792565 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:57:47.096741 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:57:49.528295 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:57:49.528406 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:57:49.528489 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:57:49.528563 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:57:49.528647 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:57:49.528733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:57:49.528806 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:57:49.830329 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:57:57.973788 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:57:57.973904 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:57:57.973978 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:57:57.974053 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:57:57.974139 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:57:57.974215 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:57:57.974297 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:57:58.273325 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:58:17.350854 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:58:17.350991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:58:17.351078 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:58:17.351152 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:58:17.351241 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:58:17.351316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:58:17.351388 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:58:17.659216 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:58:20.105206 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:58:20.105290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:58:20.105362 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:58:20.105465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:58:20.105556 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:58:20.105639 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:58:20.105712 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:58:20.417146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:58:47.925775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:58:47.925881 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:58:47.925966 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:58:47.926032 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:58:47.926096 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:58:47.926157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:58:47.926216 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:58:48.237791 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:58:50.683796 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:58:50.683877 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:58:50.683947 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:58:50.684014 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:58:50.684075 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:58:50.684130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:58:50.684189 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:58:50.989169 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:58:58.093778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:58:58.093857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:58:58.093945 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:58:58.094006 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:58:58.094072 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:58:58.094133 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:58:58.094199 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:58:58.397525 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:59:18.498681 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:59:18.498786 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:59:18.498858 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:59:18.498927 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:59:18.498991 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:59:18.499057 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:59:18.499124 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:59:18.810049 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:59:21.248862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:59:21.248943 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:59:21.249020 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:59:21.249094 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:59:21.249167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:59:21.249229 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:59:21.249287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:59:21.557927 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:59:49.073256 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:59:49.073375 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:59:49.073454 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:59:49.073544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:59:49.073622 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:59:49.073701 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:59:49.073786 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:59:49.383328 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:59:51.828671 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:59:51.828775 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:59:51.828858 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:59:51.828938 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:59:51.829013 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:59:51.829087 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:59:51.829163 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:59:52.141362 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 09:59:58.212669 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 09:59:58.212757 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 09:59:58.212838 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 09:59:58.212901 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 09:59:58.212971 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 09:59:58.213042 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 09:59:58.213113 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 09:59:58.529860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:00:19.651746 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:00:19.651828 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:00:19.651899 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:00:19.651972 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:00:19.652039 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:00:19.652103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:00:19.652170 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:00:19.960246 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:00:22.405581 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:00:22.405664 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:00:22.405736 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:00:22.405803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:00:22.405866 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:00:22.405928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:00:22.405987 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:00:22.710845 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:00:50.227873 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:00:50.227995 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:00:50.228829 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:00:50.229093 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:00:50.229268 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:00:50.229432 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:00:50.229579 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:00:50.528351 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:00:52.975699 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:00:52.975809 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:00:52.975879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:00:52.975951 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:00:52.976019 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:00:52.976082 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:00:52.976147 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:00:53.284321 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:00:58.330877 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:00:58.330956 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:00:58.331022 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:00:58.331085 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:00:58.331153 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:00:58.331215 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:00:58.331276 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:00:58.632282 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:01:20.789867 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:01:20.789952 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:01:20.790023 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:01:20.790088 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:01:20.790156 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:01:20.790218 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:01:20.790286 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:01:21.094879 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:01:23.556227 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:01:23.556320 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:01:23.556385 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:01:23.556456 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:01:23.556524 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:01:23.556590 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:01:23.556655 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:01:23.859085 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:01:51.352942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:01:51.353028 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:01:51.353099 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:01:51.353167 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:01:51.353232 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:01:51.353296 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:01:51.353367 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:01:51.657329 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:01:54.126252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:01:54.126356 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:01:54.126447 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:01:54.126515 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:01:54.126599 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:01:54.126659 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:01:54.126758 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:01:54.446601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:01:58.449516 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:01:58.449589 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:01:58.449658 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:01:58.449738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:01:58.449810 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:01:58.449866 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:01:58.449933 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:01:58.757115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:02:21.919080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:02:21.919193 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:02:21.919260 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:02:21.919412 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:02:21.919492 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:02:21.919587 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:02:21.919665 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:02:22.252848 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:02:24.708277 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:02:24.708376 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:02:24.708448 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:02:24.708526 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:02:24.708599 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:02:24.708672 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:02:24.708747 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:02:25.017264 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:02:52.522616 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:02:52.522703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:02:52.522790 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:02:52.522868 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:02:52.522926 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:02:52.523003 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:02:52.523068 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:02:52.828533 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:02:55.290762 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:02:55.290846 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:02:55.290910 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:02:55.290972 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:02:55.291049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:02:55.291113 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:02:55.291175 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:02:55.597803 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:02:58.572251 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:02:58.572365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:02:58.572463 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:02:58.572545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:02:58.572613 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:02:58.572686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:02:58.572767 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:02:58.884483 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:03:23.095743 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:03:23.095828 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:03:23.095894 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:03:23.095960 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:03:23.096022 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:03:23.096092 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:03:23.096159 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:03:23.398991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:03:25.857386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:03:25.857474 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:03:25.857542 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:03:25.857605 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:03:25.857667 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:03:25.857735 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:03:25.857796 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:03:26.167177 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:03:53.663727 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:03:53.663812 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:03:53.663883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:03:53.663948 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:03:53.664012 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:03:53.664070 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:03:53.664134 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:03:53.969388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:03:56.434624 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:03:56.434726 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:03:56.434806 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:03:56.434876 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:03:56.434938 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:03:56.435005 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:03:56.435076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:03:56.743088 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:03:58.688777 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:03:58.688864 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:03:58.688926 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:03:58.688999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:03:58.689060 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:03:58.689126 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:03:58.689193 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:03:59.012240 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:04:24.241323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:04:24.241424 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:04:24.241500 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:04:24.241574 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:04:24.241639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:04:24.241708 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:04:24.241792 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:04:24.547570 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:04:27.007106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:04:27.007190 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:04:27.007259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:04:27.007320 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:04:27.007383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:04:27.007443 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:04:27.007507 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:04:27.315654 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:04:54.812054 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:04:54.812146 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:04:54.812221 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:04:54.812290 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:04:54.812352 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:04:54.812420 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:04:54.812495 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:04:55.115981 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:04:57.594883 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:04:57.595008 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:04:57.595088 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:04:57.595165 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:04:57.595245 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:04:57.595321 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:04:57.595392 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:04:57.906946 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:04:58.806425 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:04:58.806519 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:04:58.806599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:04:58.806674 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:04:58.806760 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:04:58.806837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:04:58.806920 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:04:59.123359 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:05:25.381910 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:05:25.382001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:05:25.382084 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:05:25.382153 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:05:25.382227 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:05:25.382302 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:05:25.382383 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:05:25.695616 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:05:28.166664 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:05:28.166782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:05:28.166855 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:05:28.166916 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:05:28.166977 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:05:28.167038 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:05:28.167105 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:05:28.473416 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:05:55.955282 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:05:55.955373 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:05:55.955444 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:05:55.955511 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:05:55.955573 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:05:55.955643 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:05:55.955704 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:05:56.258862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:05:58.729678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:05:58.729768 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:05:58.729848 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:05:58.729909 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:05:58.729972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:05:58.730034 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:05:58.730104 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:05:59.046563 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:05:59.307884 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:05:59.307989 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:05:59.308092 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:05:59.308170 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:05:59.308261 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:05:59.308334 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:05:59.308419 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:05:59.607832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:06:26.521756 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:06:26.521858 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:06:26.521929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:06:26.522003 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:06:26.522076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:06:26.522148 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:06:26.522223 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:06:26.826658 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:06:29.307750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:06:29.307836 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:06:29.307911 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:06:29.308002 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:06:29.308071 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:06:29.308138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:06:29.308212 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:06:29.609939 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:06:57.090325 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:06:57.090417 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:06:57.090489 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:06:57.090558 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:06:57.090633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:06:57.090702 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:06:57.090777 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:06:57.395902 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:06:59.038982 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:06:59.039059 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:06:59.039124 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:06:59.039189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:06:59.039256 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:06:59.039323 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:06:59.039384 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:06:59.345317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:06:59.872502 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:06:59.872585 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:06:59.872649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:06:59.872710 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:06:59.872797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:06:59.872859 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:06:59.872925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:07:00.183216 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:07:27.653700 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:07:27.653787 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:07:27.653860 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:07:27.653924 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:07:27.653990 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:07:27.654063 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:07:27.654129 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:07:27.963515 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:07:30.454787 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:07:30.454865 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:07:30.454935 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:07:30.454998 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:07:30.455061 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:07:30.455121 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:07:30.455188 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:07:30.760942 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:07:58.223842 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:07:58.223953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:07:58.224052 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:07:58.224131 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:07:58.224209 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:07:58.224289 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:07:58.224373 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:07:58.528460 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:07:59.163653 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:07:59.163757 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:07:59.163849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:07:59.163936 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:07:59.164011 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:07:59.164087 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:07:59.164164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:07:59.470974 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:08:01.028945 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:08:01.029065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:08:01.029141 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:08:01.029227 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:08:01.029307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:08:01.029400 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:08:01.029472 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:08:01.334322 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:08:28.786988 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:08:28.787087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:08:28.787164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:08:28.787246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:08:28.787327 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:08:28.787402 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:08:28.787464 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:08:29.099603 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:08:31.597447 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:08:31.597550 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:08:31.597621 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:08:31.597694 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:08:31.597789 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:08:31.597867 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:08:31.597953 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:08:31.915870 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:08:59.285747 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:08:59.285835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:08:59.285923 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:08:59.285990 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:08:59.286060 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:08:59.286131 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:08:59.286198 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:08:59.593000 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:08:59.850852 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:08:59.850929 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:08:59.850993 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:08:59.851070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:08:59.851133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:08:59.851196 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:08:59.851262 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:09:00.158636 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:09:02.195353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:09:02.195441 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:09:02.195504 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:09:02.195568 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:09:02.195630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:09:02.195695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:09:02.195761 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:09:02.509606 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:09:29.853490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:09:29.853604 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:09:29.853681 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:09:29.853785 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:09:29.853876 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:09:29.853961 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:09:29.854044 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:09:30.166414 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:09:32.769656 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:09:32.769770 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:09:32.769841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:09:32.769919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:09:32.769997 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:09:32.770072 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:09:32.770144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:09:33.080387 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:09:59.406693 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:09:59.406783 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:09:59.406855 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:09:59.406924 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:09:59.406992 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:09:59.407062 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:09:59.407133 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:09:59.714287 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:10:00.423857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:10:00.423940 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:10:00.424016 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:10:00.424077 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:10:00.424141 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:10:00.424201 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:10:00.424264 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:10:00.725382 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:10:03.342429 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:10:03.342545 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:10:03.342614 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:10:03.342680 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:10:03.342752 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:10:03.342811 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:10:03.342879 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:10:03.652051 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:10:30.988879 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:10:30.988972 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:10:30.989036 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:10:30.989098 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:10:30.989161 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:10:30.989219 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:10:30.989280 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:10:31.296287 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:10:33.914094 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:10:33.914187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:10:33.914254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:10:33.914322 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:10:33.914387 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:10:33.914459 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:10:33.914519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:10:34.228350 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:10:59.524112 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:10:59.524192 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:10:59.524275 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:10:59.525480 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:10:59.526505 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:10:59.526944 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:10:59.527294 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:10:59.829844 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:11:01.553046 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:11:01.553137 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:11:01.553227 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:11:01.553308 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:11:01.553385 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:11:01.553466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:11:01.553550 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:11:01.864601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:11:04.491659 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:11:04.491773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:11:04.491848 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:11:04.491922 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:11:04.491998 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:11:04.492066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:11:04.492135 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:11:04.799019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:11:32.147298 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:11:32.147404 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:11:32.147475 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:11:32.147540 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:11:32.147604 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:11:32.147667 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:11:32.147730 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:11:32.453677 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:11:35.061408 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:11:35.061492 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:11:35.061565 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:11:35.061646 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:11:35.061712 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:11:35.061784 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:11:35.061850 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:11:35.362875 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:11:59.643671 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:11:59.643760 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:11:59.643834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:11:59.643895 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:11:59.643963 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:11:59.644022 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:11:59.644093 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:11:59.950996 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:12:02.721783 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:12:02.721876 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:12:02.721954 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:12:02.722017 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:12:02.722083 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:12:02.722158 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:12:02.722233 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:12:03.028915 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:12:05.630136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:12:05.630231 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:12:05.630309 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:12:05.630386 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:12:05.630459 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:12:05.630535 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:12:05.630610 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:12:05.936192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:12:33.292237 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:12:33.292332 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:12:33.292406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:12:33.292480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:12:33.292549 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:12:33.292620 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:12:33.292698 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:12:33.601379 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:12:36.194423 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:12:36.194503 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:12:36.194572 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:12:36.194638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:12:36.194705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:12:36.194775 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:12:36.194843 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:12:36.493628 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:12:59.762146 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:12:59.762224 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:12:59.762287 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:12:59.762351 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:12:59.762412 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:12:59.762475 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:12:59.762545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:13:00.090146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:13:03.865975 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:13:03.866061 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:13:03.866126 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:13:03.866191 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:13:03.866252 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:13:03.866316 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:13:03.866381 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:13:04.166966 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:13:06.751093 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:13:06.751301 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:13:06.751444 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:13:06.751809 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:13:06.752353 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:13:06.753049 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:13:06.753134 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:13:07.054209 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:13:34.425830 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:13:34.425938 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:13:34.426023 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:13:34.426098 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:13:34.426180 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:13:34.426260 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:13:34.426339 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:13:34.726726 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:13:37.311343 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:13:37.311457 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:13:37.311553 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:13:37.311635 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:13:37.311715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:13:37.311837 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:13:37.311920 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:13:37.624413 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:13:59.880840 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:13:59.880932 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:13:59.881008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:13:59.881081 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:13:59.881149 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:13:59.881226 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:13:59.881297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:14:00.194659 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:14:04.992263 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:14:04.992375 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:14:04.992454 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:14:04.992531 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:14:04.992610 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:14:04.992689 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:14:04.992781 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:14:05.294231 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:14:07.882247 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:14:07.882343 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:14:07.882426 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:14:07.882502 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:14:07.882576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:14:07.882646 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:14:07.882729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:14:08.187580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:14:35.563808 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:14:35.563895 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:14:35.563961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:14:35.564029 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:14:35.564097 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:14:35.564160 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:14:35.564226 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:14:35.868295 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:14:38.454231 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:14:38.454312 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:14:38.454378 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:14:38.454436 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:14:38.454503 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:14:38.454562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:14:38.454626 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:14:38.758774 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:15:00.006148 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:15:00.006233 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:15:00.006310 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:15:00.006372 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:15:00.006445 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:15:00.006508 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:15:00.006571 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:15:00.320897 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:15:06.125802 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:15:06.125889 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:15:06.125957 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:15:06.126019 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:15:06.126087 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:15:06.126146 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:15:06.126218 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:15:06.424888 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:15:09.017003 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:15:09.017090 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:15:09.017167 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:15:09.017233 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:15:09.017302 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:15:09.017372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:15:09.017437 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:15:09.331276 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:15:36.680896 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:15:36.681011 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:15:36.681883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:15:36.682345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:15:36.682484 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:15:36.682614 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:15:36.683391 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:15:36.989313 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:15:39.609302 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:15:39.609403 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:15:39.609481 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:15:39.609562 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:15:39.609639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:15:39.609727 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:15:39.609812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:15:39.920413 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:16:00.129350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:16:00.129444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:16:00.129519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:16:00.129600 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:16:00.129678 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:16:00.129773 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:16:00.129854 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:16:00.431392 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:16:07.252183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:16:07.252281 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:16:07.252368 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:16:07.252440 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:16:07.252518 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:16:07.252589 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:16:07.252665 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:16:07.553426 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:16:10.186133 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:16:10.186238 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:16:10.186326 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:16:10.186412 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:16:10.186488 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:16:10.186573 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:16:10.186651 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:16:10.487565 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:16:37.809519 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:16:37.809640 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:16:37.809726 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:16:37.809806 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:16:37.809890 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:16:37.809966 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:16:37.810042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:16:38.110589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:16:40.743498 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:16:40.743609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:16:40.743697 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:16:40.743786 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:16:40.743865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:16:40.743952 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:16:40.744033 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:16:41.050014 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:17:00.256596 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:17:00.256704 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:17:00.256787 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:17:00.256891 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:17:00.256969 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:17:00.257049 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:17:00.257131 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:17:00.560580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:17:08.370467 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:17:08.370564 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:17:08.370645 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:17:08.370724 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:17:08.370809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:17:08.370901 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:17:08.370977 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:17:08.679068 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:17:11.315911 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:17:11.316017 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:17:11.316091 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:17:11.316174 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:17:11.316246 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:17:11.316318 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:17:11.316391 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:17:11.615252 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:17:38.937056 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:17:38.937138 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:17:38.937203 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:17:38.937268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:17:38.937339 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:17:38.937405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:17:38.937470 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:17:39.245465 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:17:41.879908 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:17:41.879988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:17:41.880058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:17:41.880123 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:17:41.880190 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:17:41.880254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:17:41.880319 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:17:42.205437 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:18:00.382424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:18:00.382534 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:18:00.382609 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:18:00.382692 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:18:00.382769 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:18:00.382838 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:18:00.382917 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:18:00.688865 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:18:09.504158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:18:09.504245 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:18:09.504316 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:18:09.504384 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:18:09.504454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:18:09.504521 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:18:09.504590 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:18:09.810494 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:18:12.474559 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:18:12.474651 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:18:12.474723 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:18:12.474791 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:18:12.474858 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:18:12.474920 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:18:12.474986 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:18:12.778583 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:18:40.083245 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:18:40.083345 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:18:40.083442 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:18:40.083517 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:18:40.083596 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:18:40.083670 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:18:40.083758 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:18:40.391835 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:18:43.042470 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:18:43.042559 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:18:43.042633 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:18:43.042700 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:18:43.042812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:18:43.042908 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:18:43.042991 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:18:43.344210 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:19:00.503533 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:19:00.503642 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:19:00.503737 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:19:00.503834 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:19:00.503913 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:19:00.504018 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:19:00.504087 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:19:00.805377 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:19:10.653262 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:19:10.653364 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:19:10.653446 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:19:10.653538 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:19:10.653617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:19:10.653699 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:19:10.653777 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:19:10.958042 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:19:13.598684 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:19:13.598788 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:19:13.598867 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:19:13.598940 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:19:13.599007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:19:13.599078 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:19:13.599148 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:19:13.918398 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:19:41.225692 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:19:41.225800 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:19:41.225870 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:19:41.225935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:19:41.225998 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:19:41.226068 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:19:41.226139 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:19:41.534007 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:19:44.177964 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:19:44.178061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:19:44.178156 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:19:44.178235 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:19:44.178315 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:19:44.178392 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:19:44.178465 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:19:44.485093 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:20:00.627172 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:20:00.627257 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:20:00.627340 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:20:00.627427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:20:00.627517 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:20:00.627591 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:20:00.627664 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:20:00.927485 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:20:11.793490 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:20:11.794205 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:20:11.794454 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:20:11.795389 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:20:11.795568 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:20:11.795684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:20:11.795791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:20:12.129160 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:20:14.745931 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:20:14.746059 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:20:14.746141 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:20:14.746221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:20:14.746299 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:20:14.746383 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:20:14.746453 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:20:15.045990 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:20:42.392021 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:20:42.392126 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:20:42.392204 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:20:42.392270 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:20:42.392348 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:20:42.392422 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:20:42.392493 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:20:42.693964 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:20:45.303032 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:20:45.303136 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:20:45.303215 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:20:45.303291 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:20:45.303369 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:20:45.303449 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:20:45.303524 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:20:45.605078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:21:00.751381 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:21:00.751468 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:21:00.751548 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:21:00.751617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:21:00.751686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:21:00.751766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:21:00.751839 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:21:01.049960 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:21:12.955283 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:21:12.955392 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:21:12.955461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:21:12.955527 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:21:12.955593 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:21:12.955654 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:21:12.955727 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:21:13.260957 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:21:15.860125 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:21:15.860229 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:21:15.860303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:21:15.860393 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:21:15.860466 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:21:15.860541 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:21:15.860612 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:21:16.171421 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:21:43.521804 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:21:43.521891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:21:43.521963 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:21:43.522026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:21:43.522089 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:21:43.522152 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:21:43.522220 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:21:43.828235 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:21:46.429368 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:21:46.429470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:21:46.429533 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:21:46.429599 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:21:46.429660 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:21:46.429728 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:21:46.429789 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:21:46.734864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:22:00.877924 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:22:00.878003 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:22:00.878077 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:22:00.878138 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:22:00.878201 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:22:00.878261 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:22:00.878325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:22:01.189365 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:22:14.093407 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:22:14.093493 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:22:14.093558 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:22:14.093636 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:22:14.093693 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:22:14.093762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:22:14.093821 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:22:14.403639 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:22:16.995266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:22:16.995358 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:22:16.995436 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:22:16.995501 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:22:16.995559 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:22:16.995622 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:22:16.995681 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:22:17.301658 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:22:44.670312 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:22:44.670394 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:22:44.670462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:22:44.670534 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:22:44.670602 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:22:44.670676 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:22:44.670750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:22:44.974231 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:22:47.559709 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:22:47.559799 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:22:47.559862 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:22:47.559926 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:22:47.559989 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:22:47.560055 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:22:47.560116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:22:47.872479 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:23:01.010775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:23:01.010874 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:23:01.010944 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:23:01.011012 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:23:01.011080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:23:01.011148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:23:01.011212 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:23:01.321085 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:23:15.229203 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:23:15.229293 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:23:15.229359 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:23:15.229423 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:23:15.229488 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:23:15.229565 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:23:15.229623 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:23:15.534232 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:23:18.132811 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:23:18.132894 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:23:18.132964 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:23:18.133032 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:23:18.133098 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:23:18.133165 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:23:18.133231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:23:18.444058 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:23:45.799519 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:23:45.799632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:23:45.799716 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:23:45.799798 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:23:45.799866 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:23:45.799939 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:23:45.800005 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:23:46.104542 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:23:48.705548 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:23:48.705637 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:23:48.705708 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:23:48.705775 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:23:48.705841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:23:48.705904 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:23:48.705965 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:23:49.020231 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:24:01.135447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:24:01.135524 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:24:01.135590 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:24:01.135648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:24:01.135714 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:24:01.135779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:24:01.135845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:24:01.438197 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:24:16.362920 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:24:16.363026 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:24:16.363112 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:24:16.363200 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:24:16.363258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:24:16.363325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:24:16.363390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:24:16.664356 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:24:19.290115 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:24:19.290206 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:24:19.290280 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:24:19.290371 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:24:19.290470 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:24:19.290557 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:24:19.290628 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:24:19.598859 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:24:46.927237 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:24:46.927327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:24:46.928031 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:24:46.928477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:24:46.928610 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:24:46.928747 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:24:46.929463 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:24:47.230441 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:24:49.872292 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:24:49.872382 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:24:49.872451 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:24:49.872513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:24:49.872574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:24:49.872642 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:24:49.872705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:24:50.194920 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:25:01.260375 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:25:01.260448 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:25:01.260513 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:25:01.260579 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:25:01.260642 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:25:01.260702 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:25:01.260774 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:25:01.571041 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:25:17.487857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:25:17.487940 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:25:17.488018 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:25:17.488078 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:25:17.488140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:25:17.488201 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:25:17.488263 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:25:17.805873 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:25:20.454823 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:25:20.454922 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:25:20.454993 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:25:20.455065 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:25:20.455127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:25:20.455195 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:25:20.455254 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:25:20.757669 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:25:48.068708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:25:48.068812 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:25:48.068882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:25:48.068947 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:25:48.069010 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:25:48.069074 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:25:48.069135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:25:48.375946 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:25:51.021168 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:25:51.021275 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:25:51.021342 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:25:51.021412 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:25:51.021481 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:25:51.021542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:25:51.021598 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:25:51.322061 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:26:01.390540 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:26:01.390656 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:26:01.390746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:26:01.390826 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:26:01.390910 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:26:01.390993 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:26:01.391076 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:26:01.698078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:26:18.644779 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:26:18.644889 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:26:18.644975 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:26:18.645056 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:26:18.645136 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:26:18.645215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:26:18.645300 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:26:18.954410 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:26:21.584081 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:26:21.584178 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:26:21.584248 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:26:21.584325 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:26:21.584403 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:26:21.584474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:26:21.584547 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:26:21.897824 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:26:49.215941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:26:49.216067 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:26:49.216143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:26:49.216206 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:26:49.216274 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:26:49.216339 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:26:49.216401 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:26:49.523837 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:26:52.173920 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:26:52.174013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:26:52.174083 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:26:52.174145 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:26:52.174209 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:26:52.174272 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:26:52.174336 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:26:52.478137 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:27:01.520130 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:27:01.520224 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:27:01.520308 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:27:01.520386 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:27:01.520448 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:27:01.520516 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:27:01.520584 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:27:01.827113 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:27:19.783767 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:27:19.783854 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:27:19.783928 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:27:19.784002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:27:19.784070 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:27:19.784142 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:27:19.784208 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:27:20.095166 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:27:22.734997 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:27:22.735085 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:27:22.735151 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:27:22.735221 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:27:22.735284 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:27:22.735349 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:27:22.735411 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:27:23.041351 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:27:50.356957 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:27:50.357062 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:27:50.357143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:27:50.357222 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:27:50.357299 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:27:50.357381 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:27:50.357458 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:27:50.656854 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:27:53.299805 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:27:53.299904 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:27:53.299982 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:27:53.300061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:27:53.300130 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:27:53.300207 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:27:53.300280 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:27:53.609526 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:28:01.640484 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:28:01.640570 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:28:01.640638 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:28:01.640700 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:28:01.640764 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:28:01.640842 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:28:01.640901 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:28:01.952862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:28:20.914049 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:28:20.914142 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:28:20.914210 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:28:20.914284 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:28:20.914364 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:28:20.914428 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:28:20.914489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:28:21.219171 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:28:23.870095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:28:23.870179 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:28:23.870251 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:28:23.870320 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:28:23.870382 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:28:23.870446 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:28:23.870505 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:28:24.173606 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:28:51.479683 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:28:51.479799 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:28:51.479896 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:28:51.479969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:28:51.480059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:28:51.480134 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:28:51.480218 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:28:51.786293 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:28:54.435593 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:28:54.435702 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:28:54.435815 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:28:54.435897 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:28:54.435974 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:28:54.436059 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:28:54.436134 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:28:54.738430 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:29:01.768624 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:29:01.768729 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:29:01.768797 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:29:01.768870 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:29:01.768945 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:29:01.769017 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:29:01.769083 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:29:02.085099 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:29:22.059087 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:29:22.059197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:29:22.059282 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:29:22.059369 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:29:22.059453 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:29:22.059551 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:29:22.059631 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:29:22.395260 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:29:24.994415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:29:24.994515 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:29:24.994591 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:29:24.994668 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:29:24.994752 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:29:24.994832 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:29:24.994900 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:29:25.308041 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:29:52.650512 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:29:52.650631 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:29:52.650691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:29:52.650764 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:29:52.650828 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:29:52.650890 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:29:52.650952 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:29:52.964980 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:29:55.575922 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:29:55.576026 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:29:55.576103 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:29:55.576182 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:29:55.576270 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:29:55.576358 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:29:55.576432 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:29:55.883580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:30:01.907566 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:30:01.907668 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:30:01.907752 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:30:01.907822 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:30:01.907898 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:30:01.907971 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:30:01.908048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:30:02.234803 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:30:23.228349 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:30:23.228449 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:30:23.228514 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:30:23.229363 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:30:23.229822 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:30:23.230160 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:30:23.230750 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:30:23.541015 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:30:26.145105 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:30:26.145204 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:30:26.145274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:30:26.145339 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:30:26.145405 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:30:26.145471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:30:26.145541 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:30:26.450876 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:30:53.805009 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:30:53.805127 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:30:53.805202 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:30:53.805292 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:30:53.805373 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:30:53.805449 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:30:53.805529 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:30:54.108627 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:30:56.712764 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:30:56.712911 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:30:56.712997 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:30:56.713075 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:30:56.713165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:30:56.713237 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:30:56.713320 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:30:57.018348 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:31:02.027204 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:31:02.027306 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:31:02.027381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:31:02.027458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:31:02.027543 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:31:02.027617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:31:02.027691 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:31:02.343256 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:31:24.390371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:31:24.390476 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:31:24.390548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:31:24.390615 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:31:24.390680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:31:24.390763 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:31:24.390834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:31:24.700317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:31:27.281192 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:31:27.281308 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:31:27.281405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:31:27.281503 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:31:27.281609 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:31:27.281697 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:31:27.281799 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:31:27.584468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:31:54.970087 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:31:54.970205 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:31:54.970294 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:31:54.970377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:31:54.970467 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:31:54.970546 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:31:54.970623 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:31:55.286270 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:31:57.839907 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:31:57.840054 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:31:57.840136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:31:57.840233 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:31:57.840318 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:31:57.840431 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:31:57.840520 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:31:58.141053 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:32:02.151356 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:32:02.151452 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:32:02.151542 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:32:02.151637 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:32:02.151729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:32:02.151815 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:32:02.151906 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:32:02.462847 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:32:25.544381 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:32:25.544514 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:32:25.544615 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:32:25.544710 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:32:25.544810 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:32:25.544911 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:32:25.545000 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:32:25.854008 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:32:28.401960 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:32:28.402097 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:32:28.402199 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:32:28.402284 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:32:28.402374 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:32:28.402443 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:32:28.402537 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:32:28.705394 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:32:56.119193 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:32:56.119298 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:32:56.119370 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:32:56.119449 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:32:56.119522 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:32:56.119591 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:32:56.119661 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:32:56.429778 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:32:58.970545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:32:58.970636 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:32:58.970704 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:32:58.970772 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:32:58.970834 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:32:58.970898 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:32:58.970960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:32:59.288238 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:33:02.273791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:33:02.273872 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:33:02.273936 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:33:02.273999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:33:02.274062 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:33:02.274132 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:33:02.274198 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:33:02.586869 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:33:26.691798 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:33:26.691898 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:33:26.691975 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:33:26.692048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:33:26.692114 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:33:26.692188 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:33:26.692267 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:33:27.007174 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:33:29.552758 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:33:29.552862 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:33:29.552929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:33:29.553000 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:33:29.553068 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:33:29.553136 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:33:29.553201 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:33:29.858164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:33:57.272792 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:33:57.272884 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:33:57.272944 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:33:57.273014 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:33:57.273074 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:33:57.273144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:33:57.273213 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:33:57.592706 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:34:00.125051 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:34:00.125167 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:34:00.125247 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:34:00.125325 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:34:00.125403 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:34:00.125474 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:34:00.125550 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:34:00.426247 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:34:02.390687 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:34:02.390791 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:34:02.390869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:34:02.390947 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:34:02.391031 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:34:02.391107 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:34:02.391172 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:34:02.699640 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:34:27.857159 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:34:27.857256 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:34:27.857321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:34:27.857389 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:34:27.857455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:34:27.857520 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:34:27.857584 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:34:28.159433 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:34:30.683732 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:34:30.683819 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:34:30.683882 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:34:30.683959 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:34:30.684024 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:34:30.684088 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:34:30.684144 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:34:30.993337 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:34:58.417402 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:34:58.418443 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:34:58.418980 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:34:58.419767 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:34:58.420136 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:34:58.420320 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:34:58.421164 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:34:58.728308 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:35:01.257013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:35:01.257110 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:35:01.257184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:35:01.257256 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:35:01.257329 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:35:01.257398 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:35:01.257468 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:35:01.574081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:35:02.516048 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:35:02.516149 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:35:02.516220 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:35:02.516287 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:35:02.516349 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:35:02.516414 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:35:02.516474 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:35:02.827521 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:35:28.992964 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:35:28.993055 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:35:28.993134 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:35:28.993210 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:35:28.993293 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:35:28.993371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:35:28.993449 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:35:29.303167 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:35:31.840823 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:35:31.840947 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:35:31.841040 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:35:31.841124 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:35:31.841197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:35:31.841275 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:35:31.841353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:35:32.155659 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:35:59.567510 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:35:59.567621 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:35:59.567704 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:35:59.567790 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:35:59.567880 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:35:59.567954 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:35:59.568025 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:35:59.864910 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:36:02.423683 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:36:02.423812 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:36:02.423917 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:36:02.424029 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:36:02.424114 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:36:02.424190 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:36:02.424302 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:36:02.727349 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:36:02.987457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:36:02.987563 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:36:02.987639 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:36:02.987729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:36:02.987811 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:36:02.987887 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:36:02.987962 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:36:03.298582 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:36:30.133761 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:36:30.133872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:36:30.133946 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:36:30.134016 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:36:30.134087 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:36:30.134153 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:36:30.134225 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:36:30.445552 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:36:32.988697 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:36:32.988802 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:36:32.988890 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:36:32.988973 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:36:32.989056 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:36:32.989129 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:36:32.989200 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:36:33.294030 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:37:00.708320 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:37:00.708439 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:37:00.708513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:37:00.708585 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:37:00.708655 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:37:00.708743 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:37:00.708828 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:37:01.013914 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:37:02.757496 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:37:02.757579 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:37:02.757646 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:37:02.757715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:37:02.757786 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:37:02.757849 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:37:02.757915 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:37:03.064123 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:37:03.554072 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:37:03.554175 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:37:03.554240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:37:03.554325 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:37:03.554392 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:37:03.554456 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:37:03.554523 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:37:03.856464 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:37:31.281891 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:37:31.281990 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:37:31.282070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:37:31.282153 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:37:31.282238 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:37:31.282326 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:37:31.282401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:37:31.593638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:37:34.122149 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:37:34.122260 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:37:34.122330 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:37:34.122405 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:37:34.122482 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:37:34.122555 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:37:34.122631 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:37:34.443638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:38:01.852483 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:38:01.852587 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:38:01.852655 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:38:01.852726 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:38:01.852791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:38:01.852850 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:38:01.852915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:38:02.180426 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:38:02.888139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:38:02.888234 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:38:02.888300 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:38:02.888367 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:38:02.888433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:38:02.888513 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:38:02.888585 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:38:03.187662 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:38:04.706378 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:38:04.706475 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:38:04.706553 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:38:04.706635 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:38:04.706724 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:38:04.706801 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:38:04.706874 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:38:05.020578 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:38:32.443966 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:38:32.444087 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:38:32.444172 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:38:32.444255 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:38:32.444327 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:38:32.444401 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:38:32.444480 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:38:32.747781 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:38:35.289195 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:38:35.289297 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:38:35.289396 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:38:35.289482 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:38:35.289565 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:38:35.289649 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:38:35.289741 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:38:35.590131 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:39:03.010501 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:39:03.010617 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:39:03.010705 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:39:03.010786 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:39:03.010862 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:39:03.010937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:39:03.011026 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:39:03.313153 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:39:03.567069 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:39:03.567162 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:39:03.567243 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:39:03.567326 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:39:03.567401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:39:03.567475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:39:03.567552 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:39:03.861489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:39:05.843954 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:39:05.844077 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:39:05.844149 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:39:05.844226 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:39:05.844297 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:39:05.844395 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:39:05.844472 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:39:06.140961 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:39:33.568082 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:39:33.568173 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:39:33.568245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:39:33.568315 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:39:33.568376 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:39:33.568440 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:39:33.568511 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:39:33.875249 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:39:36.397175 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:39:36.397285 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:39:36.397386 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:39:36.397470 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:39:36.397568 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:39:36.397656 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:39:36.397784 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:39:36.699059 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:40:03.139849 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:40:03.139951 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:40:03.140040 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:40:03.140125 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:40:03.140199 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:40:03.140295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:40:03.140371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:40:03.445937 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:40:04.137368 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:40:04.137464 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:40:04.137539 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:40:04.137622 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:40:04.137693 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:40:04.137779 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:40:04.137853 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:40:04.449024 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:40:06.964442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:40:06.964546 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:40:06.964616 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:40:06.964694 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:40:06.964770 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:40:06.964861 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:40:06.964940 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:40:07.284239 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:40:34.717358 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:40:34.717457 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:40:34.717532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:40:34.717607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:40:34.717688 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:40:34.717794 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:40:34.717868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:40:35.024723 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:40:37.550302 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:40:37.550396 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:40:37.550463 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:40:37.550536 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:40:37.550601 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:40:37.550669 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:40:37.550744 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:40:37.854273 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:41:03.257873 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:41:03.257958 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:41:03.258029 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:41:03.258093 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:41:03.258167 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:41:03.258230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:41:03.258300 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:41:03.562441 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:41:05.290839 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:41:05.290929 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:41:05.291010 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:41:05.291091 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:41:05.291156 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:41:05.291226 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:41:05.291292 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:41:05.595460 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:41:08.120984 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:41:08.121072 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:41:08.121139 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:41:08.121200 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:41:08.121263 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:41:08.121335 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:41:08.121406 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:41:08.430232 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:41:35.862282 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:41:35.862368 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:41:35.862447 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:41:35.862515 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:41:35.862574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:41:35.862643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:41:35.862706 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:41:36.167184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:41:38.695446 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:41:38.696077 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:41:38.696188 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:41:38.696277 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:41:38.696364 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:41:38.696449 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:41:38.696532 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:41:39.006489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:42:03.379186 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:42:03.379265 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:42:03.379337 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:42:03.379409 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:42:03.379478 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:42:03.379541 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:42:03.379606 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:42:03.692742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:42:06.430023 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:42:06.430113 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:42:06.430182 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:42:06.430254 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:42:06.430327 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:42:06.430400 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:42:06.430470 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:42:06.740165 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:42:09.271667 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:42:09.271752 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:42:09.271819 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:42:09.271882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:42:09.271954 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:42:09.272013 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:42:09.272077 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:42:09.579537 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:42:36.998853 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:42:36.998938 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:42:36.999000 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:42:36.999090 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:42:36.999156 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:42:36.999217 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:42:36.999284 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:42:37.302446 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:42:39.841079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:42:39.841182 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:42:39.841254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:42:39.841322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:42:39.841382 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:42:39.841448 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:42:39.841510 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:42:40.149816 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:43:03.506370 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:43:03.506678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:43:03.507117 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:43:03.507584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:43:03.507665 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:43:03.507755 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:43:03.507837 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:43:03.809913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:43:07.574563 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:43:07.574660 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:43:07.574736 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:43:07.574811 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:43:07.574887 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:43:07.574959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:43:07.575024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:43:07.880055 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:43:10.417706 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:43:10.417798 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:43:10.417866 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:43:10.417929 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:43:10.417994 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:43:10.418056 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:43:10.418119 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:43:10.724169 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:43:38.143996 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:43:38.144105 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:43:38.144170 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:43:38.144234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:43:38.144303 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:43:38.144369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:43:38.144432 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:43:38.454169 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:43:40.989331 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:43:40.989433 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:43:40.989516 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:43:40.989599 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:43:40.989678 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:43:40.989791 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:43:40.989874 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:43:41.295955 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:44:03.627600 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:44:03.627700 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:44:03.627771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:44:03.627849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:44:03.627923 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:44:03.627989 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:44:03.628052 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:44:03.931712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:44:08.714924 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:44:08.715177 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:44:08.715953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:44:08.717047 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:44:08.717161 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:44:08.717233 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:44:08.717298 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:44:09.026707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:44:11.567787 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:44:11.567920 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:44:11.568014 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:44:11.568097 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:44:11.568174 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:44:11.568254 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:44:11.568334 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:44:11.871824 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:44:39.296986 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:44:39.297106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:44:39.297173 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:44:39.297246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:44:39.297316 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:44:39.297387 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:44:39.297452 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:44:39.597267 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:44:42.146620 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:44:42.146706 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:44:42.146780 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:44:42.146849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:44:42.146913 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:44:42.146977 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:44:42.147043 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:44:42.451873 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:45:03.751127 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:45:03.751217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:45:03.751303 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:45:03.751362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:45:03.751428 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:45:03.751495 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:45:03.751559 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:45:04.056208 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:45:09.850762 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:45:09.850866 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:45:09.850951 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:45:09.851031 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:45:09.851107 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:45:09.851186 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:45:09.851267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:45:10.161824 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:45:12.710508 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:45:12.710725 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:45:12.711456 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:45:12.711604 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:45:12.711683 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:45:12.711770 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:45:12.711850 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:45:13.014040 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:45:40.421543 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:45:40.421631 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:45:40.421742 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:45:40.421810 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:45:40.421906 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:45:40.421973 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:45:40.422043 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:45:40.728176 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:45:43.273634 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:45:43.273733 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:45:43.273804 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:45:43.273872 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:45:43.273938 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:45:43.274000 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:45:43.274066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:45:43.580149 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:46:03.871124 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:46:03.871206 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:46:03.871273 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:46:03.871353 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:46:03.871411 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:46:03.871480 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:46:03.871542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:46:04.175860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:46:10.991432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:46:10.991532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:46:10.991602 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:46:10.991661 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:46:10.991747 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:46:10.991807 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:46:10.991877 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:46:11.294519 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:46:13.843748 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:46:13.843843 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:46:13.843907 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:46:13.843975 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:46:13.844043 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:46:13.844103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:46:13.844183 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:46:14.155666 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:46:41.550036 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:46:41.550126 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:46:41.550191 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:46:41.550261 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:46:41.550325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:46:41.550391 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:46:41.550463 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:46:41.854672 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:46:44.418972 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:46:44.419065 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:46:44.419136 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:46:44.419205 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:46:44.419270 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:46:44.419337 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:46:44.419406 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:46:44.729415 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:47:03.988722 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:47:03.988801 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:47:03.988866 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:47:03.988928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:47:03.988994 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:47:03.989066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:47:03.989131 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:47:04.295478 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:47:12.117608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:47:12.117691 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:47:12.117771 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:47:12.117849 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:47:12.117914 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:47:12.117976 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:47:12.118041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:47:12.428827 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:47:14.987099 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:47:14.987217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:47:14.987281 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:47:14.987349 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:47:14.987410 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:47:14.987480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:47:14.987542 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:47:15.287680 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:47:42.686218 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:47:42.686414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:47:42.686577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:47:42.686977 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:47:42.687394 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:47:42.688075 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:47:42.688165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:47:42.990933 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:47:45.549461 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:47:45.549555 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:47:45.549625 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:47:45.549698 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:47:45.549765 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:47:45.549834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:47:45.549902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:47:45.854679 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:48:04.112051 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:48:04.112132 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:48:04.112201 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:48:04.112269 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:48:04.112331 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:48:04.112399 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:48:04.112461 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:48:04.445122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:48:13.251124 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:48:13.251246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:48:13.251320 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:48:13.251396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:48:13.251478 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:48:13.251551 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:48:13.251625 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:48:13.553406 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:48:16.116062 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:48:16.116158 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:48:16.116234 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:48:16.116312 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:48:16.116379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:48:16.116445 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:48:16.116526 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:48:16.422580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:48:43.806969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:48:43.807095 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:48:43.807202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:48:43.807269 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:48:43.807349 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:48:43.807432 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:48:43.807512 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:48:44.113944 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:48:46.681667 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:48:46.681794 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:48:46.681885 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:48:46.681970 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:48:46.682062 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:48:46.682143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:48:46.682215 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:48:46.995627 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:49:04.234806 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:49:04.234886 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:49:04.234959 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:49:04.235028 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:49:04.235092 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:49:04.235161 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:49:04.235229 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:49:04.539565 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:49:14.381377 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:49:14.381467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:49:14.381539 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:49:14.381604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:49:14.381682 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:49:14.381750 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:49:14.381816 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:49:14.699216 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:49:17.257276 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:49:17.257388 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:49:17.257454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:49:17.257518 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:49:17.257581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:49:17.257649 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:49:17.257726 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:49:17.570872 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:49:44.969361 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:49:44.969463 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:49:44.969533 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:49:44.969601 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:49:44.969668 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:49:44.969750 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:49:44.969817 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:49:45.278073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:49:47.846511 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:49:47.846625 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:49:47.846687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:49:47.846760 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:49:47.846830 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:49:47.846894 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:49:47.846959 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:49:48.150099 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:50:04.353274 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:50:04.353355 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:50:04.353426 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:50:04.353498 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:50:04.353563 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:50:04.353629 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:50:04.353696 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:50:04.672820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:50:15.531672 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:50:15.531766 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:50:15.531834 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:50:15.531901 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:50:15.531967 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:50:15.532024 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:50:15.532088 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:50:15.835101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:50:18.412261 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:50:18.412355 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:50:18.412420 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:50:18.412490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:50:18.412555 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:50:18.412621 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:50:18.412687 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:50:18.718750 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:50:46.100053 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:50:46.100164 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:50:46.100225 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:50:46.100292 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:50:46.100358 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:50:46.100420 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:50:46.100480 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:50:46.411984 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:50:48.979619 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:50:48.979715 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:50:48.979790 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:50:48.979863 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:50:48.979921 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:50:48.979986 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:50:48.980052 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:50:49.293941 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:51:04.475869 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:51:04.476015 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:51:04.476152 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:51:04.476741 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:51:04.477682 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:51:04.477787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:51:04.477855 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:51:04.785928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:51:16.683613 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:51:16.683708 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:51:16.683808 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:51:16.683882 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:51:16.683959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:51:16.684035 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:51:16.684112 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:51:16.990232 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:51:19.557851 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:51:19.557964 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:51:19.558033 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:51:19.558110 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:51:19.558186 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:51:19.558254 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:51:19.558322 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:51:19.870335 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:51:47.254125 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:51:47.254211 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:51:47.254273 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:51:47.254339 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:51:47.254399 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:51:47.254462 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:51:47.254520 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:51:47.562602 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:51:50.146494 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:51:50.146644 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:51:50.146742 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:51:50.146830 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:51:50.146911 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:51:50.146989 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:51:50.147061 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:51:50.454432 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:52:04.596758 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:52:04.596855 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:52:04.596936 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:52:04.597009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:52:04.597086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:52:04.597170 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:52:04.597248 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:52:04.918325 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:52:17.834303 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:52:17.834918 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:52:17.835376 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:52:17.835559 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:52:17.835713 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:52:17.836516 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:52:17.836627 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:52:18.141423 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:52:20.722453 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:52:20.722553 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:52:20.722640 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:52:20.722712 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:52:20.722792 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:52:20.722860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:52:20.722926 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:52:21.028463 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:52:48.404483 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:52:48.404593 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:52:48.404658 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:52:48.404727 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:52:48.404811 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:52:48.404877 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:52:48.404945 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:52:48.719116 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:52:51.290865 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:52:51.290951 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:52:51.291012 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:52:51.291076 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:52:51.291140 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:52:51.291209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:52:51.291269 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:52:51.599897 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:53:04.722219 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:53:04.722301 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:53:04.722376 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:53:04.722441 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:53:04.722507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:53:04.722568 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:53:04.722633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:53:05.044361 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:53:18.982189 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:53:18.982274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:53:18.982346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:53:18.982414 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:53:18.982482 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:53:18.982543 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:53:18.982608 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:53:19.293095 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:53:21.862812 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:53:21.862914 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:53:21.862977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:53:21.863044 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:53:21.863105 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:53:21.863168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:53:21.863230 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:53:22.176534 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:53:49.553667 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:53:49.553765 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:53:49.553842 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:53:49.553906 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:53:49.553971 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:53:49.554033 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:53:49.554118 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:53:49.871511 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:53:52.438211 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:53:52.438295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:53:52.438369 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:53:52.438437 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:53:52.438503 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:53:52.438559 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:53:52.438627 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:53:52.745928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:54:04.847110 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:54:04.847190 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:54:04.847266 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:54:04.847331 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:54:04.847390 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:54:04.847459 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:54:04.847518 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:54:05.155899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:54:20.144046 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:54:20.144160 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:54:20.144240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:54:20.144314 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:54:20.144387 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:54:20.144470 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:54:20.144544 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:54:20.455659 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:54:23.010712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:54:23.010810 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:54:23.010870 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:54:23.010939 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:54:23.011002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:54:23.011069 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:54:23.011130 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:54:23.317897 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:54:50.722921 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:54:50.723012 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:54:50.723086 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:54:50.723155 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:54:50.723219 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:54:50.723288 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:54:50.723357 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:54:51.027288 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:54:53.582050 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:54:53.582152 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:54:53.582233 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:54:53.582309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:54:53.582388 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:54:53.582475 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:54:53.582566 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:54:53.885191 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:55:04.973774 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:55:04.973888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:55:04.973961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:55:04.974036 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:55:04.974107 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:55:04.974178 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:55:04.974247 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:55:05.280713 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:55:21.290241 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:55:21.290355 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:55:21.290425 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:55:21.290490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:55:21.290556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:55:21.290623 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:55:21.290691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:55:21.600308 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:55:24.149839 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:55:24.149924 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:55:24.149997 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:55:24.150064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:55:24.150135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:55:24.150196 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:55:24.150260 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:55:24.462950 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:55:51.871497 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:55:51.871642 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:55:51.871743 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:55:51.871842 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:55:51.871934 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:55:51.872022 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:55:51.872108 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:55:52.199803 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:55:54.726833 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:55:54.726938 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:55:54.727015 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:55:54.727096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:55:54.727173 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:55:54.727249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:55:54.727319 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:55:55.033573 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:56:05.096120 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:56:05.096221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:56:05.096290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:56:05.096353 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:56:05.096419 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:56:05.096487 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:56:05.096549 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:56:05.401946 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:56:22.464679 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:56:22.464788 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:56:22.464867 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:56:22.464938 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:56:22.465026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:56:22.465096 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:56:22.465166 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:56:22.772760 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:56:25.303400 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:56:25.303503 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:56:25.303583 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:56:25.303660 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:56:25.303738 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:56:25.303813 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:56:25.303885 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:56:25.607294 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:56:53.036635 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:56:53.036734 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:56:53.036808 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:56:53.036884 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:56:53.036952 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:56:53.037018 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:56:53.037079 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:56:53.341484 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:56:55.867078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:56:55.867160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:56:55.867239 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:56:55.867309 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:56:55.867396 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:56:55.867464 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:56:55.867534 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:56:56.176241 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:57:05.217542 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:57:05.217620 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:57:05.217686 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:57:05.217758 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:57:05.217827 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:57:05.217893 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:57:05.217957 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:57:05.529753 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:57:23.613084 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:57:23.613173 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:57:23.613238 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:57:23.613305 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:57:23.613371 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:57:23.613439 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:57:23.613499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:57:23.915594 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:57:26.436352 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:57:26.436467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:57:26.436556 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:57:26.436648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:57:26.436730 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:57:26.436808 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:57:26.436876 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:57:26.739699 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:57:54.179290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:57:54.179390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:57:54.179469 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:57:54.179544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:57:54.179622 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:57:54.179703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:57:54.179783 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:57:54.488904 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:57:57.007197 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:57:57.007298 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:57:57.007375 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:57:57.007452 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:57:57.008052 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:57:57.008915 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:57:57.009609 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:57:57.320587 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:58:05.340859 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:58:05.340970 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:58:05.341049 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:58:05.341130 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:58:05.341211 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:58:05.341278 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:58:05.341357 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:58:05.645514 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:58:24.746598 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:58:24.746703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:58:24.746782 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:58:24.746860 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:58:24.746937 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:58:24.747024 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:58:24.747103 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:58:25.057223 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:58:27.597141 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:58:27.597258 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:58:27.597345 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:58:27.597427 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:58:27.597492 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:58:27.597558 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:58:27.597625 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:58:27.902127 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:58:55.327565 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:58:55.327676 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:58:55.327765 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:58:55.327847 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:58:55.327925 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:58:55.328007 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:58:55.328079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:58:55.631793 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:58:58.159772 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:58:58.159882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:58:58.159957 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:58:58.160038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:58:58.160122 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:58:58.160198 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:58:58.160283 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:58:58.464770 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:59:05.462711 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:59:05.463662 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:59:05.464212 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:59:05.464476 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:59:05.464990 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:59:05.465413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:59:05.465585 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:59:05.771880 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:59:25.898029 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:59:25.898122 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:59:25.898197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:59:25.898266 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:59:25.898336 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:59:25.898411 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:59:25.898472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:59:26.201769 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:59:28.721883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:59:28.721971 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:59:28.722053 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:59:28.722122 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:59:28.722181 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:59:28.722242 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:59:28.722314 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:59:29.033656 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:59:56.459142 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:59:56.459268 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:59:56.459331 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:59:56.459400 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:59:56.459462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:59:56.459530 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:59:56.459589 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:59:56.773181 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 10:59:59.297588 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 10:59:59.297686 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 10:59:59.297761 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 10:59:59.297844 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 10:59:59.297913 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 10:59:59.297977 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 10:59:59.298049 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 10:59:59.599301 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:00:05.586862 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:00:05.586942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:00:05.587009 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:00:05.587083 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:00:05.587148 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:00:05.587218 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:00:05.587284 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:00:05.896064 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:00:27.037766 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:00:27.037880 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:00:27.037951 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:00:27.038043 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:00:27.038113 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:00:27.038185 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:00:27.038257 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:00:27.343876 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:00:29.852864 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:00:29.852945 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:00:29.853015 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:00:29.853084 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:00:29.853151 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:00:29.853215 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:00:29.853285 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:00:30.175589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:00:57.606963 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:00:57.607066 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:00:57.607159 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:00:57.607234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:00:57.607308 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:00:57.607380 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:00:57.607452 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:00:57.914828 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:01:00.438794 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:01:00.438888 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:01:00.438971 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:01:00.439045 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:01:00.439121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:01:00.439189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:01:00.439259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:01:00.747222 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:01:05.711537 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:01:05.711618 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:01:05.711690 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:01:05.711765 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:01:05.711829 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:01:05.711900 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:01:05.711969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:01:06.020443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:01:28.180091 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:01:28.180172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:01:28.180230 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:01:28.180297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:01:28.180369 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:01:28.180427 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:01:28.180486 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:01:28.485372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:01:31.011006 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:01:31.011113 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:01:31.011183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:01:31.011259 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:01:31.012228 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:01:31.012544 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:01:31.012684 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:01:31.313327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:01:58.742472 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:01:58.742562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:01:58.742633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:01:58.742697 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:01:58.742772 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:01:58.742839 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:01:58.742905 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:01:59.051050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:02:01.575351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:02:01.575437 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:02:01.575501 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:02:01.575567 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:02:01.575635 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:02:01.575694 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:02:01.575765 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:02:01.884618 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:02:05.838852 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:02:05.838948 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:02:05.839012 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:02:05.839079 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:02:05.839146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:02:05.839218 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:02:05.839279 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:02:06.151628 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:02:29.317195 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:02:29.317289 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:02:29.317353 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:02:29.317431 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:02:29.317497 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:02:29.317568 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:02:29.317627 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:02:29.630585 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:02:32.170335 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:02:32.170427 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:02:32.170507 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:02:32.170578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:02:32.170645 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:02:32.170708 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:02:32.170782 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:02:32.475063 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:02:59.897138 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:02:59.897232 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:02:59.897316 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:02:59.897385 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:02:59.897450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:02:59.897522 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:02:59.897588 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:03:00.205108 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:03:02.731858 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:03:02.731974 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:03:02.732039 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:03:02.732108 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:03:02.732167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:03:02.732233 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:03:02.732299 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:03:03.035988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:03:05.967479 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:03:05.967565 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:03:05.967633 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:03:05.967693 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:03:05.967774 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:03:05.967836 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:03:05.967904 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:03:06.274223 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:03:30.463012 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:03:30.463121 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:03:30.463188 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:03:30.463259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:03:30.463323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:03:30.463395 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:03:30.463461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:03:30.770649 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:03:33.298444 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:03:33.298537 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:03:33.298619 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:03:33.298685 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:03:33.298764 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:03:33.298826 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:03:33.298887 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:03:33.620392 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:04:01.031777 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:04:01.031879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:04:01.031945 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:04:01.032022 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:04:01.032086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:04:01.032150 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:04:01.032214 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:04:01.334908 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:04:03.878677 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:04:03.878774 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:04:03.878844 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:04:03.878923 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:04:03.879001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:04:03.879063 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:04:03.879127 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:04:04.184517 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:04:06.094852 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:04:06.094960 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:04:06.095031 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:04:06.095090 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:04:06.095156 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:04:06.095225 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:04:06.095290 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:04:06.399163 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:04:31.595203 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:04:31.595296 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:04:31.595362 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:04:31.595425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:04:31.595491 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:04:31.595552 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:04:31.595618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:04:31.913563 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:04:34.452276 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:04:34.452361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:04:34.452424 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:04:34.452484 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:04:34.452548 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:04:34.452611 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:04:34.452668 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:04:34.763799 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:05:02.185469 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:05:02.185565 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:05:02.185633 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:05:02.185706 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:05:02.185795 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:05:02.185862 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:05:02.185925 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:05:02.504081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:05:05.037799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:05:05.037905 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:05:05.037982 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:05:05.038065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:05:05.038142 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:05:05.038223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:05:05.038295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:05:05.342418 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:05:06.226319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:05:06.226434 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:05:06.226516 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:05:06.226593 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:05:06.226674 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:05:06.226763 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:05:06.226836 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:05:06.527320 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:05:32.773416 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:05:32.773514 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:05:32.773601 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:05:32.773679 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:05:32.773766 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:05:32.773848 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:05:32.773913 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:05:33.077485 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:05:35.600816 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:05:35.600935 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:05:35.601009 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:05:35.601087 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:05:35.601170 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:05:35.601244 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:05:35.601328 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:05:35.908845 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:06:03.339889 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:06:03.339983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:06:03.340054 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:06:03.340126 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:06:03.340202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:06:03.340272 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:06:03.340339 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:06:03.641492 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:06:06.172799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:06:06.173615 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:06:06.173741 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:06:06.173813 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:06:06.173925 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:06:06.173995 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:06:06.174060 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:06:06.486966 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:06:06.748309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:06:06.748408 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:06:06.748485 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:06:06.748564 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:06:06.748642 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:06:06.748730 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:06:06.748809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:06:07.052371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:06:33.909733 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:06:33.909851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:06:33.909918 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:06:33.909987 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:06:33.910055 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:06:33.910131 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:06:33.910190 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:06:34.229616 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:06:36.748596 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:06:36.748701 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:06:36.748771 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:06:36.748839 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:06:36.748910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:06:36.748980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:06:36.749046 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:06:37.052800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:07:04.490887 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:07:04.490986 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:07:04.491051 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:07:04.491120 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:07:04.491188 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:07:04.491256 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:07:04.491317 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:07:04.793906 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:07:06.481684 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:07:06.481769 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:07:06.481841 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:07:06.481915 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:07:06.481983 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:07:06.482044 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:07:06.482104 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:07:06.788011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:07:07.314529 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:07:07.314646 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:07:07.314723 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:07:07.314809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:07:07.314869 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:07:07.314957 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:07:07.315030 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:07:07.620878 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:07:35.062294 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:07:35.062375 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:07:35.062443 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:07:35.062511 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:07:35.062575 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:07:35.062642 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:07:35.062711 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:07:35.363315 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:07:37.880423 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:07:37.880510 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:07:37.880574 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:07:37.880641 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:07:37.880702 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:07:37.880773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:07:37.880833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:07:38.183084 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:08:05.627455 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:08:05.627594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:08:05.627655 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:08:05.627720 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:08:05.627784 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:08:05.627844 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:08:05.627910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:08:05.939469 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:08:06.609337 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:08:06.609427 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:08:06.609495 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:08:06.609566 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:08:06.609629 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:08:06.609695 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:08:06.609759 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:08:06.907973 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:08:08.442100 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:08:08.442190 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:08:08.442255 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:08:08.442329 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:08:08.442412 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:08:08.442477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:08:08.442549 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:08:08.753633 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:08:36.206089 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:08:36.206884 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:08:36.206986 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:08:36.207067 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:08:36.207194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:08:36.207284 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:08:36.207384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:08:36.513623 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:08:39.014002 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:08:39.014110 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:08:39.014183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:08:39.014267 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:08:39.014351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:08:39.014429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:08:39.014501 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:08:39.318147 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:09:06.737176 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:09:06.737274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:09:06.737345 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:09:06.737413 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:09:06.737481 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:09:06.737549 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:09:06.737617 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:09:07.045133 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:09:07.304837 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:09:07.304964 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:09:07.305038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:09:07.305117 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:09:07.305194 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:09:07.305272 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:09:07.305348 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:09:07.605257 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:09:09.576136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:09:09.576243 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:09:09.576313 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:09:09.576386 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:09:09.576454 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:09:09.576528 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:09:09.576591 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:09:09.881996 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:09:37.305201 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:09:37.305286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:09:37.305350 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:09:37.305418 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:09:37.305490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:09:37.305550 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:09:37.305626 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:09:37.607400 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:09:40.144669 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:09:40.144778 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:09:40.144888 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:09:40.144962 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:09:40.145025 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:09:40.145090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:09:40.145155 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:09:40.453356 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:10:06.866775 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:10:06.866861 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:10:06.866921 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:10:06.866988 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:10:06.867049 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:10:06.867121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:10:06.867183 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:10:07.166784 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:10:07.863596 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:10:07.863679 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:10:07.863747 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:10:07.863809 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:10:07.863875 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:10:07.863933 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:10:07.863998 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:10:08.170800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:10:10.716679 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:10:10.716770 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:10:10.716837 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:10:10.716903 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:10:10.716966 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:10:10.717035 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:10:10.717096 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:10:11.014939 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:10:38.428829 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:10:38.428936 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:10:38.428998 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:10:38.429070 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:10:38.429136 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:10:38.429199 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:10:38.429261 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:10:38.743840 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:10:41.273316 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:10:41.273424 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:10:41.273493 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:10:41.273558 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:10:41.273626 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:10:41.273698 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:10:41.273775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:10:41.578879 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:11:06.990802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:11:06.990883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:11:06.990970 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:11:06.991035 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:11:06.991098 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:11:06.991158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:11:06.991224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:11:07.293380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:11:09.004906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:11:09.004992 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:11:09.005061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:11:09.005123 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:11:09.005188 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:11:09.005246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:11:09.005314 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:11:09.321927 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:11:11.835860 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:11:11.835948 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:11:11.836028 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:11:11.836097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:11:11.836158 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:11:11.836219 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:11:11.836281 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:11:12.160825 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:11:39.598632 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:11:39.598711 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:11:39.598785 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:11:39.598850 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:11:39.598921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:11:39.598982 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:11:39.599050 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:11:39.911094 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:11:42.428518 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:11:42.428602 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:11:42.428668 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:11:42.428733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:11:42.428797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:11:42.428856 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:11:42.428930 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:11:42.737838 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:12:07.121539 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:12:07.121623 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:12:07.121684 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:12:07.121757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:12:07.121825 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:12:07.121892 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:12:07.121952 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:12:07.422173 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:12:10.184732 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:12:10.184844 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:12:10.184929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:12:10.185005 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:12:10.185076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:12:10.185154 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:12:10.185220 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:12:10.494373 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:12:13.003238 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:12:13.003342 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:12:13.003419 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:12:13.003498 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:12:13.003571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:12:13.003645 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:12:13.003742 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:12:13.310339 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:12:40.756729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:12:40.756813 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:12:40.756894 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:12:40.756954 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:12:40.757019 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:12:40.757078 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:12:40.757140 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:12:41.062032 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:12:43.581563 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:12:43.581654 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:12:43.581731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:12:43.581791 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:12:43.581862 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:12:43.581926 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:12:43.581984 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:12:43.885548 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:13:07.253676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:13:07.253765 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:13:07.253834 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:13:07.253905 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:13:07.253969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:13:07.254040 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:13:07.254111 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:13:07.561570 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:13:11.317459 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:13:11.317539 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:13:11.317607 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:13:11.317668 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:13:11.317744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:13:11.317828 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:13:11.317896 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:13:11.626403 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:13:14.145622 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:13:14.145730 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:13:14.145815 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:13:14.145907 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:13:14.145984 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:13:14.146060 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:13:14.146149 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:13:14.467050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:13:41.897633 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:13:41.897739 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:13:41.897820 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:13:41.897891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:13:41.897967 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:13:41.898048 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:13:41.898127 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:13:42.219124 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 11:13:44.731731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:13:44.731848 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:13:44.731926 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:13:44.732004 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:13:44.732096 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:13:44.732167 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:13:44.732247 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:13:45.038609 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 11:14:07.386073 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:14:07.386178 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:14:07.386257 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:14:07.386335 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:14:07.386412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:14:07.386478 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:14:07.386547 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:14:07.706098 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 11:14:12.484562 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:14:12.484647 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:14:12.484733 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:14:12.484796 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:14:12.484864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:14:12.484929 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:14:12.484994 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:14:12.797830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:14:15.298537 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:14:15.298636 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:14:15.298709 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:14:15.298779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:14:15.298846 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:14:15.298921 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:14:15.298988 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:14:15.605776 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:14:43.063989 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:14:43.064075 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:14:43.064144 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:14:43.064209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:14:43.064276 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:14:43.064336 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:14:43.064414 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:14:43.373551 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:14:45.865032 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:14:45.865120 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:14:45.865187 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:14:45.865248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:14:45.865313 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:14:45.865370 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:14:45.865434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:14:46.171524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:15:07.510376 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:15:07.510488 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:15:07.510558 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:15:07.510626 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:15:07.510696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:15:07.510770 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:15:07.510839 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:15:07.818290 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:15:13.635000 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:15:13.635115 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:15:13.635220 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:15:13.635309 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:15:13.635380 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:15:13.635466 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:15:13.635543 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:15:13.945625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:15:16.439329 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:15:16.439442 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:15:16.439526 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:15:16.439607 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:15:16.439684 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:15:16.439776 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:15:16.439845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:15:16.753096 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:15:44.207925 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:15:44.208031 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:15:44.208099 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:15:44.208182 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:15:44.208250 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:15:44.208331 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:15:44.208398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:15:44.526684 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:15:47.014627 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:15:47.014775 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:15:47.014860 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:15:47.014935 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:15:47.015015 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:15:47.015098 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:15:47.015172 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:15:47.318431 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:16:07.638105 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:16:07.638209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:16:07.638281 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:16:07.638351 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:16:07.638419 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:16:07.638490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:16:07.638565 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:16:07.946795 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:16:14.788431 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:16:14.788529 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:16:14.788591 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:16:14.788659 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:16:14.788726 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:16:14.788788 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:16:14.788850 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:16:15.095435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:16:17.583137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:16:17.583219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:16:17.583300 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:16:17.583371 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:16:17.583434 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:16:17.583502 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:16:17.583564 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:16:17.895902 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:16:45.354190 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:16:45.354279 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:16:45.354343 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:16:45.354417 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:16:45.354484 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:16:45.354547 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:16:45.354611 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:16:45.666965 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:16:48.154590 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:16:48.154675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:16:48.154740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:16:48.154808 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:16:48.154869 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:16:48.154932 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:16:48.154992 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:16:48.463638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:17:07.762983 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:17:07.763064 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:17:07.763129 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:17:07.763191 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:17:07.763258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:17:07.763317 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:17:07.763387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:17:08.072808 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:17:15.929469 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:17:15.929571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:17:15.929634 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:17:15.929708 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:17:15.929776 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:17:15.929845 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:17:15.929900 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:17:16.235303 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:17:18.728207 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:17:18.728289 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:17:18.728369 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:17:18.728436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:17:18.728495 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:17:18.728557 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:17:18.728623 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:17:19.033969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:17:46.503821 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:17:46.503906 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:17:46.503976 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:17:46.504045 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:17:46.504106 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:17:46.504177 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:17:46.504245 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:17:46.810762 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:17:49.295558 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:17:49.295657 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:17:49.295750 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:17:49.295840 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:17:49.295914 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:17:49.295994 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:17:49.296086 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:17:49.609398 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:18:07.889657 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:18:07.889763 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:18:07.889856 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:18:07.889936 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:18:07.890011 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:18:07.890087 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:18:07.890165 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:18:08.198299 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:18:17.073500 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:18:17.073593 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:18:17.073674 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:18:17.073761 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:18:17.073840 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:18:17.073915 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:18:17.073993 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:18:17.372815 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:18:19.883302 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:18:19.883393 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:18:19.883471 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:18:19.883556 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:18:19.883641 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:18:19.883713 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:18:19.883799 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:18:20.203259 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:18:47.635659 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:18:47.635774 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:18:47.635850 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:18:47.635924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:18:47.636003 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:18:47.636071 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:18:47.636138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:18:47.990583 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:18:50.466394 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:18:50.466486 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:18:50.466553 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:18:50.466617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:18:50.466683 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:18:50.466753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:18:50.466823 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:18:50.772461 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:19:08.020099 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:19:08.020179 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:19:08.020247 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:19:08.020309 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:19:08.020375 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:19:08.020440 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:19:08.020514 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:19:08.328167 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:19:18.254859 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:19:18.254945 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:19:18.255017 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:19:18.255080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:19:18.255146 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:19:18.255220 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:19:18.255288 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:19:18.563647 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:19:21.028417 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:19:21.028527 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:19:21.028599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:19:21.028670 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:19:21.028746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:19:21.028813 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:19:21.028880 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:19:21.332382 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:19:48.826478 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:19:48.826562 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:19:48.827379 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:19:48.827896 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:19:48.828822 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:19:48.829281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:19:48.829922 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:19:49.134429 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:19:51.592696 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:19:51.592812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:19:51.592894 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:19:51.592973 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:19:51.593051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:19:51.593135 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:19:51.593220 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:19:51.902982 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:20:08.153132 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:20:08.153243 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:20:08.153323 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:20:08.153398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:20:08.153482 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:20:08.153566 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:20:08.153644 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:20:08.456240 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:20:19.407909 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:20:19.408015 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:20:19.408092 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:20:19.408170 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:20:19.408260 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:20:19.408332 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:20:19.408400 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:20:19.714089 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:20:22.188513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:20:22.188601 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:20:22.188675 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:20:22.188749 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:20:22.188822 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:20:22.188882 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:20:22.188947 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:20:22.493802 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:20:49.980921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:20:49.981007 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:20:49.981070 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:20:49.981133 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:20:49.981198 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:20:49.981263 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:20:49.981322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:20:50.296390 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:20:52.761525 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:20:52.761639 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:20:52.761709 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:20:52.761793 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:20:52.761859 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:20:52.761956 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:20:52.762024 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:20:53.068023 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:21:08.284561 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:21:08.284641 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:21:08.284712 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:21:08.284785 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:21:08.284864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:21:08.284940 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:21:08.285017 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:21:08.590409 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:21:20.560876 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:21:20.560966 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:21:20.561035 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:21:20.561098 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:21:20.561163 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:21:20.561221 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:21:20.561287 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:21:20.861948 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:21:23.336403 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:21:23.336492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:21:23.336567 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:21:23.336632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:21:23.336702 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:21:23.336767 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:21:23.336834 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:21:23.640213 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:21:51.117583 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:21:51.117666 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:21:51.117743 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:21:51.117813 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:21:51.117881 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:21:51.117949 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:21:51.118012 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:21:51.424146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:21:53.904951 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:21:53.905039 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:21:53.905113 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:21:53.905181 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:21:53.905242 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:21:53.905306 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:21:53.905366 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:21:54.212973 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:22:08.413518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:22:08.413639 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:22:08.413747 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:22:08.413852 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:22:08.413924 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:22:08.414011 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:22:08.414090 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:22:08.723714 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:22:21.691113 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:22:21.691239 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:22:21.691314 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:22:21.691389 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:22:21.691467 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:22:21.691531 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:22:21.691605 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:22:21.996810 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:22:24.472646 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:22:24.472739 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:22:24.472823 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:22:24.472893 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:22:24.472962 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:22:24.473030 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:22:24.473091 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:22:24.773542 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:22:52.267724 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:22:52.267812 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:22:52.267892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:22:52.267952 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:22:52.268014 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:22:52.268074 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:22:52.268134 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:22:52.579341 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:22:55.040849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:22:55.040930 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:22:55.040995 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:22:55.041062 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:22:55.041129 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:22:55.041193 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:22:55.041256 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:22:55.352377 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:23:08.542292 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:23:08.542374 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:23:08.542439 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:23:08.542513 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:23:08.543090 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:23:08.543678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:23:08.543959 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:23:08.853887 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:23:20.502980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:23:20.503072 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:23:20.503136 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:23:20.503203 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:23:20.503264 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:23:20.503335 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:23:20.503397 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:23:20.808453 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:23:22.846970 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:23:22.847059 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:23:22.847127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:23:22.847187 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:23:22.847250 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:23:22.847309 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:23:22.847373 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:23:23.156862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:23:25.616125 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:23:25.616245 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:23:25.616307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:23:25.616371 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:23:25.616433 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:23:25.616496 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:23:25.616556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:23:25.923919 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:23:53.422801 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:23:53.422902 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:23:53.422977 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:23:53.423038 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:23:53.423102 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:23:53.423157 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:23:53.423221 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:23:53.732903 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:23:56.180948 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:23:56.181049 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:23:56.181122 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:23:56.181186 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:23:56.181252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:23:56.181310 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:23:56.181373 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:23:56.488421 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:24:08.670500 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:24:08.670599 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:24:08.670673 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:24:08.670768 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:24:08.670836 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:24:08.670909 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:24:08.670976 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:24:08.975091 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:24:23.998616 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:24:23.998710 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:24:23.998803 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:24:23.998887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:24:23.998959 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:24:23.999043 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:24:23.999113 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:24:24.314933 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:24:26.758385 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:24:26.758478 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:24:26.758548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:24:26.758613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:24:26.758677 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:24:26.758748 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:24:26.758815 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:24:27.069560 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:24:54.580121 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:24:54.580205 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:24:54.580275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:24:54.580340 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:24:54.580405 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:24:54.580471 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:24:54.580533 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:24:54.880442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:24:57.333225 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:24:57.333310 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:24:57.333396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:24:57.333465 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:24:57.333534 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:24:57.333599 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:24:57.333657 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:24:57.641729 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:25:08.796735 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:25:08.796813 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:25:08.796882 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:25:08.796949 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:25:08.797012 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:25:08.797074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:25:08.797143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:25:09.110834 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:25:25.148458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:25:25.148566 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:25:25.148628 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:25:25.148697 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:25:25.148770 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:25:25.148842 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:25:25.148907 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:25:25.458015 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:25:27.901955 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:25:27.902071 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:25:27.902145 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:25:27.902212 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:25:27.902278 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:25:27.902342 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:25:27.902413 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:25:28.209453 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:25:55.725592 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:25:55.725689 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:25:55.725767 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:25:55.725837 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:25:55.725907 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:25:55.725978 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:25:55.726046 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:25:56.029387 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:25:58.468322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:25:58.468421 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:25:58.468489 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:25:58.468551 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:25:58.468617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:25:58.468691 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:25:58.468772 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:25:58.779829 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:26:08.927186 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:26:08.927291 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:26:08.927375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:26:08.927454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:26:08.927531 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:26:08.927613 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:26:08.927698 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:26:09.242495 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:26:26.290189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:26:26.290304 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:26:26.290381 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:26:26.290456 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:26:26.290547 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:26:26.290614 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:26:26.290687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:26:26.599360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:26:29.049874 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:26:29.049973 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:26:29.050040 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:26:29.050101 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:26:29.051311 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:26:29.051613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:26:29.052212 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:26:29.374820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:26:56.865158 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:26:56.865256 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:26:56.865335 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:26:56.865413 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:26:56.865490 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:26:56.865572 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:26:56.865648 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:26:57.168273 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:26:59.659950 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:26:59.660047 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:26:59.660128 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:26:59.660208 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:26:59.660289 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:26:59.660365 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:26:59.660447 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:26:59.969174 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:27:09.055836 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:27:09.055941 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:27:09.056022 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:27:09.056108 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:27:09.056196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:27:09.056267 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:27:09.056348 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:27:09.364604 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:27:27.431117 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:27:27.431207 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:27:27.431292 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:27:27.431373 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:27:27.431450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:27:27.431527 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:27:27.431595 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:27:27.730988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:27:30.245436 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:27:30.245534 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:27:30.245602 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:27:30.245667 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:27:30.245744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:27:30.245809 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:27:30.245872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:27:30.549948 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:27:57.987509 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:27:57.987623 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:27:57.987695 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:27:57.987802 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:27:57.989177 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:27:57.989665 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:27:57.990200 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:27:58.291245 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:28:00.818314 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:28:00.818404 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:28:00.818471 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:28:00.818543 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:28:00.818614 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:28:00.818681 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:28:00.818764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:28:01.137891 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:28:09.183462 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:28:09.183544 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:28:09.183625 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:28:09.183693 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:28:09.183772 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:28:09.183842 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:28:09.183911 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:28:09.485801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:28:28.554240 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:28:28.554326 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:28:28.554394 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:28:28.554463 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:28:28.554532 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:28:28.554594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:28:28.554659 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:28:28.861167 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:28:31.402383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:28:31.402484 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:28:31.402548 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:28:31.402620 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:28:31.402681 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:28:31.402756 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:28:31.402822 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:28:31.704649 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:28:59.126986 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:28:59.127104 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:28:59.127166 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:28:59.127232 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:28:59.127296 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:28:59.127359 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:28:59.127431 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:28:59.437846 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:29:01.981459 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:29:01.981544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:29:01.981616 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:29:01.981678 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:29:01.981758 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:29:01.981827 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:29:01.981896 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:29:02.326365 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:29:09.319898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:29:09.320002 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:29:09.320075 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:29:09.320158 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:29:09.320231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:29:09.320316 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:29:09.320397 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:29:09.627457 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:29:29.696501 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:29:29.696593 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:29:29.696678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:29:29.696761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:29:29.696842 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:29:29.696922 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:29:29.696995 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:29:30.003460 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:29:32.586982 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:29:32.587088 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:29:32.587175 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:29:32.587255 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:29:32.587346 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:29:32.587416 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:29:32.587493 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:29:32.895917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:30:00.276923 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:30:00.277017 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:30:00.277100 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:30:00.277234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:30:00.277319 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:30:00.277419 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:30:00.277512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:30:00.600916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:30:03.162297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:30:03.162395 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:30:03.162471 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:30:03.162536 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:30:03.162622 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:30:03.162697 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:30:03.162773 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:30:03.468530 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:30:09.439748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:30:09.439835 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:30:09.439903 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:30:09.439981 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:30:09.440055 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:30:09.440125 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:30:09.440186 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:30:09.745994 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:30:30.867418 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:30:30.867529 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:30:30.867598 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:30:30.867669 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:30:30.867739 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:30:30.867827 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:30:30.867895 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:30:31.176880 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:30:33.739685 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:30:33.739808 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:30:33.739898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:30:33.740005 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:30:33.740095 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:30:33.740214 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:30:33.740301 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:30:34.048503 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:31:01.437577 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:31:01.437687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:31:01.437772 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:31:01.437850 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:31:01.437923 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:31:01.438002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:31:01.438065 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:31:01.752749 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:31:04.308317 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:31:04.308400 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:31:04.308475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:31:04.308544 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:31:04.308612 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:31:04.308680 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:31:04.308764 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:31:04.609679 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:31:09.561891 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:31:09.561972 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:31:09.562036 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:31:09.562099 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:31:09.562171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:31:09.562244 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:31:09.562309 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:31:09.867681 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:31:32.017992 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:31:32.018074 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:31:32.018146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:31:32.018211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:31:32.018283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:31:32.018345 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:31:32.018412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:31:32.343129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:31:34.877855 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:31:34.877947 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:31:34.878018 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:31:34.878087 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:31:34.878157 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:31:34.878224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:31:34.878292 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:31:35.189265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:32:02.608308 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:32:02.608408 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:32:02.608509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:32:02.608587 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:32:02.608673 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:32:02.608759 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:32:02.608851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:32:02.912097 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:32:05.450128 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:32:05.450249 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:32:05.450322 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:32:05.450393 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:32:05.450467 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:32:05.450537 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:32:05.450607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:32:05.763195 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:32:09.687442 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:32:09.687735 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:32:09.688339 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:32:09.688871 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:32:09.689470 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:32:09.689571 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:32:09.689701 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:32:09.991778 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:32:33.170805 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:32:33.170899 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:32:33.170967 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:32:33.171037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:32:33.171102 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:32:33.171172 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:32:33.171242 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:32:33.474685 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:32:36.024391 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:32:36.024496 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:32:36.024582 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:32:36.024660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:32:36.024745 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:32:36.024819 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:32:36.024907 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:32:36.329463 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:33:03.749648 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:33:03.749750 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:33:03.749830 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:33:03.749919 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:33:03.750009 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:33:03.750088 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:33:03.750173 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:33:04.061146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:33:06.587402 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:33:06.587507 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:33:06.587597 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:33:06.587675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:33:06.587763 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:33:06.587837 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:33:06.587900 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:33:06.901034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:33:09.808482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:33:09.808573 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:33:09.808665 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:33:09.808743 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:33:09.808829 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:33:09.808909 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:33:09.808989 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:33:10.125122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:33:34.326923 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:33:34.327045 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:33:34.327143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:33:34.327230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:33:34.327321 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:33:34.327395 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:33:34.328702 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:33:34.632830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:33:37.163307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:33:37.163415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:33:37.163492 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:33:37.163558 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:33:37.163628 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:33:37.163694 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:33:37.163771 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:33:37.469879 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:34:04.901248 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:34:04.901338 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:34:04.901408 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:34:04.901479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:34:04.901552 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:34:04.901617 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:34:04.901682 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:34:05.220180 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:34:07.727143 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:34:07.727255 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:34:07.727339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:34:07.727408 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:34:07.727474 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:34:07.727542 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:34:07.727608 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:34:08.027786 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:34:09.934756 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:34:09.934846 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:34:09.934920 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:34:09.934987 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:34:09.935052 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:34:09.935118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:34:09.935202 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:34:10.238744 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:34:35.488521 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:34:35.488612 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:34:35.488687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:34:35.488759 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:34:35.488826 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:34:35.488899 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:34:35.488961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:34:35.809185 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:34:38.283550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:34:38.283660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:34:38.283730 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:34:38.283794 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:34:38.283861 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:34:38.283927 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:34:38.283995 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:34:38.595352 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:35:06.082097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:35:06.082182 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:35:06.082254 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:35:06.082345 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:35:06.082419 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:35:06.082485 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:35:06.082559 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:35:06.385443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:35:08.858919 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:35:08.859006 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:35:08.859083 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:35:08.859149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:35:08.859211 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:35:08.859269 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:35:08.859334 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:35:09.164738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:35:10.059492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:35:10.059573 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:35:10.059637 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:35:10.059704 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:35:10.059776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:35:10.059840 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:35:10.059906 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:35:10.369434 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:35:36.644977 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:35:36.645077 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:35:36.645142 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:35:36.645210 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:35:36.645273 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:35:36.645341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:35:36.645413 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:35:36.944635 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:35:39.421123 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:35:39.421224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:35:39.421282 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:35:39.421346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:35:39.421414 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:35:39.421481 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:35:39.421541 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:35:39.725797 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:36:07.207204 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:36:07.207313 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:36:07.207397 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:36:07.207465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:36:07.207535 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:36:07.207600 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:36:07.207664 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:36:07.511191 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:36:09.988908 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:36:09.989008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:36:09.989087 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:36:09.989150 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:36:09.989217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:36:09.989281 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:36:09.989345 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:36:10.310283 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:36:10.570831 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:36:10.570921 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:36:10.570986 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:36:10.571057 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:36:10.571122 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:36:10.571190 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:36:10.571252 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:36:10.871963 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:36:37.772620 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:36:37.772713 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:36:37.772784 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:36:37.772858 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:36:37.772920 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:36:37.772982 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:36:37.773047 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:36:38.077807 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:36:40.569090 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:36:40.569176 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:36:40.569247 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:36:40.569314 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:36:40.569381 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:36:40.569447 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:36:40.569509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:36:40.883084 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:37:08.337781 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:37:08.337864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:37:08.337932 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:37:08.338015 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:37:08.338082 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:37:08.338145 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:37:08.338210 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:37:08.644053 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:37:10.306072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:37:10.306156 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:37:10.306224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:37:10.306295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:37:10.306365 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:37:10.306426 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:37:10.306496 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:37:10.610157 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:37:11.150505 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:37:11.150603 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:37:11.150672 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:37:11.150742 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:37:11.150805 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:37:11.150872 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:37:11.150933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:37:11.448777 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:37:38.905346 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:37:38.905442 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:37:38.905502 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:37:38.905572 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:37:38.905632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:37:38.905700 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:37:38.905791 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:37:39.220979 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:37:41.707949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:37:41.708051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:37:41.708136 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:37:41.708206 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:37:41.708265 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:37:41.708331 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:37:41.708390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:37:42.034526 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:38:09.475001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:38:09.475109 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:38:09.475178 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:38:09.475248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:38:09.475319 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:38:09.475924 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:38:09.476588 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:38:09.786206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:38:10.434755 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:38:10.434841 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:38:10.434907 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:38:10.434974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:38:10.435044 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:38:10.435111 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:38:10.435178 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:38:10.743261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:38:12.313907 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:38:12.313987 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:38:12.314055 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:38:12.314118 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:38:12.314181 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:38:12.314243 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:38:12.314309 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:38:12.616050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:38:40.045775 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:38:40.045942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:38:40.046079 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:38:40.046227 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:38:40.046357 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:38:40.046491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:38:40.046616 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:38:40.367291 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:38:42.882624 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:38:42.882714 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:38:42.882798 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:38:42.882874 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:38:42.882950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:38:42.883024 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:38:42.883093 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:38:43.182594 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:39:10.555255 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:39:10.555342 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:39:10.555410 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:39:10.555475 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:39:10.555541 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:39:10.555607 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:39:10.555675 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:39:10.865449 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:39:11.123842 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:39:11.123942 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:39:11.124022 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:39:11.124094 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:39:11.124154 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:39:11.125565 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:39:11.125860 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:39:11.434001 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:39:13.446697 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:39:13.446819 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:39:13.446904 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:39:13.446985 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:39:13.447068 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:39:13.447147 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:39:13.447226 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:39:13.749274 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:39:41.124700 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:39:41.124795 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:39:41.124882 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:39:41.124956 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:39:41.125032 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:39:41.125110 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:39:41.125187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:39:41.428232 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:39:44.018262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:39:44.018375 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:39:44.018460 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:39:44.018545 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:39:44.018622 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:39:44.018699 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:39:44.018785 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:39:44.323357 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:40:10.679666 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:40:10.679778 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:40:10.679856 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:40:10.679927 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:40:10.680020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:40:10.680103 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:40:10.680205 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:40:10.986415 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:40:11.695358 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:40:11.695473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:40:11.695546 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:40:11.695618 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:40:11.695695 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:40:11.695775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:40:11.695863 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:40:11.997253 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:40:14.586096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:40:14.586185 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:40:14.586262 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:40:14.586338 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:40:14.586413 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:40:14.586499 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:40:14.586566 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:40:14.883775 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:40:42.272704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:40:42.272804 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:40:42.272883 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:40:42.272954 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:40:42.273025 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:40:42.273094 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:40:42.273161 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:40:42.574287 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:40:45.145588 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:40:45.145682 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:40:45.145790 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:40:45.145880 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:40:45.145962 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:40:45.146044 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:40:45.146124 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:40:45.456908 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:41:10.802388 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:41:10.802483 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:41:10.802562 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:41:10.802637 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:41:10.802713 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:41:10.802787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:41:10.802861 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:41:11.113221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 11:41:12.833958 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:41:12.834069 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:41:12.834135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:41:12.834200 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:41:12.834264 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:41:12.834329 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:41:12.834395 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:41:13.141476 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 11:41:15.736940 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:41:15.737044 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:41:15.737118 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:41:15.737194 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:41:15.737270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:41:15.737355 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:41:15.737425 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:41:16.048913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:41:43.400370 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:41:43.400476 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:41:43.400556 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:41:43.400621 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:41:43.400697 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:41:43.400781 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:41:43.400852 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:41:43.700868 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:41:46.312087 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:41:46.312170 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:41:46.312237 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:41:46.312305 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:41:46.312375 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:41:46.312440 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:41:46.312507 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:41:46.618944 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:42:10.924731 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:42:10.924819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:42:10.924893 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:42:10.924961 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:42:10.925027 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:42:10.925097 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:42:10.925164 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:42:11.229464 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:42:13.971895 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:42:13.971988 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:42:13.972068 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:42:13.972141 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:42:13.972218 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:42:13.972291 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:42:13.972370 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:42:14.278760 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:42:16.877269 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:42:16.877406 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:42:16.877492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:42:16.877573 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:42:16.877655 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:42:16.877738 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:42:16.877811 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:42:17.180063 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:42:44.540697 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:42:44.540800 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:42:44.540872 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:42:44.540945 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:42:44.541020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:42:44.541084 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:42:44.541171 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:42:44.846854 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:42:47.439480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:42:47.439563 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:42:47.439642 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:42:47.439714 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:42:47.439791 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:42:47.439855 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:42:47.439923 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:42:47.751516 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:43:11.046484 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:43:11.046563 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:43:11.046632 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:43:11.046696 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:43:11.046766 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:43:11.046828 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:43:11.046891 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:43:11.362812 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:43:15.110077 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:43:15.110173 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:43:15.110253 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:43:15.110337 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:43:15.110427 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:43:15.110501 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:43:15.110578 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:43:15.412989 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:43:18.015360 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:43:18.015486 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:43:18.015563 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:43:18.015639 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:43:18.015709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:43:18.015791 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:43:18.015866 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:43:18.324448 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:43:45.676347 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:43:45.676435 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:43:45.676514 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:43:45.676582 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:43:45.676652 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:43:45.676730 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:43:45.676793 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:43:45.980304 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:43:48.589069 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:43:48.589161 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:43:48.589235 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:43:48.589302 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:43:48.589370 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:43:48.589433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:43:48.589494 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:43:48.897812 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:44:11.167742 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:44:11.167836 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:44:11.167917 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:44:11.167987 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:44:11.168053 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:44:11.168116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:44:11.168186 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:44:11.479934 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:44:16.241017 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:44:16.241124 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:44:16.241196 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:44:16.241258 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:44:16.241320 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:44:16.241383 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:44:16.241446 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:44:16.556392 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:44:19.161164 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:44:19.161254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:44:19.161326 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:44:19.161393 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:44:19.161459 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:44:19.161531 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:44:19.161596 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:44:19.470624 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:44:46.825414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:44:46.825511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:44:46.825580 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:44:46.825649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:44:46.825708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:44:46.825777 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:44:46.825839 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:44:47.123444 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:44:49.737268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:44:49.737384 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:44:49.737460 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:44:49.737532 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:44:49.737593 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:44:49.737650 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:44:49.737721 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:44:50.049384 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:45:11.293765 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:45:11.293861 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:45:11.293939 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:45:11.294020 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:45:11.294095 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:45:11.294166 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:45:11.294254 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:45:11.600825 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:45:17.387835 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:45:17.387932 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:45:17.388012 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:45:17.388084 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:45:17.388180 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:45:17.388254 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:45:17.388328 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:45:17.707887 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:45:20.312031 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:45:20.312121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:45:20.312191 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:45:20.312251 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:45:20.312324 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:45:20.312396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:45:20.312466 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:45:20.608171 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:45:47.974204 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:45:47.974307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:45:47.974374 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:45:47.974437 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:45:47.974503 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:45:47.974562 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:45:47.974635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:45:48.279036 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:45:50.865780 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:45:50.865872 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:45:50.865935 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:45:50.866014 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:45:50.866080 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:45:50.866140 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:45:50.866200 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:45:51.171937 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:46:11.413342 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:46:11.413425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:46:11.413494 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:46:11.413558 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:46:11.413630 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:46:11.413694 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:46:11.413790 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:46:11.719911 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:46:18.542054 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:46:18.542132 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:46:18.542209 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:46:18.542272 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:46:18.542346 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:46:18.542412 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:46:18.542481 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:46:18.842601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:46:21.432780 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:46:21.432879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:46:21.432952 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:46:21.433016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:46:21.433088 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:46:21.433151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:46:21.433213 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:46:21.736829 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:46:49.097517 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:46:49.097611 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:46:49.097678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:46:49.097758 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:46:49.097828 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:46:49.097895 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:46:49.097960 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:46:49.397098 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:46:51.995306 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:46:51.995398 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:46:51.995461 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:46:51.995528 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:46:51.995590 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:46:51.995654 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:46:51.995726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:46:52.325956 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:47:11.536710 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:47:11.536809 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:47:11.536883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:47:11.536951 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:47:11.537029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:47:11.537099 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:47:11.537162 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:47:11.853943 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:47:19.657807 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:47:19.657907 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:47:19.657973 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:47:19.658037 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:47:19.658103 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:47:19.658167 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:47:19.658232 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:47:19.963772 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:47:22.589219 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:47:22.589305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:47:22.589385 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:47:22.589453 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:47:22.589522 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:47:22.589584 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:47:22.589650 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:47:22.889134 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:47:50.236253 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:47:50.236339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:47:50.236416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:47:50.236486 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:47:50.236556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:47:50.236620 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:47:50.236696 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:47:50.537692 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:47:53.145057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:47:53.145139 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:47:53.145233 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:47:53.145296 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:47:53.145362 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:47:53.145426 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:47:53.145491 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:47:53.450704 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:48:11.660486 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:48:11.660567 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:48:11.660640 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:48:11.660706 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:48:11.660780 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:48:11.660847 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:48:11.660915 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:48:11.962849 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:48:20.805199 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:48:20.805296 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:48:20.805362 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:48:20.805421 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:48:20.805478 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:48:20.805536 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:48:20.805596 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:48:21.105139 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:48:23.709154 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:48:23.709244 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:48:23.709312 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:48:23.709373 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:48:23.709441 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:48:23.709498 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:48:23.709560 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:48:24.013144 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:48:51.364740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:48:51.364839 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:48:51.364926 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:48:51.364993 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:48:51.365060 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:48:51.365125 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:48:51.365189 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:48:51.666091 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:48:54.276103 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:48:54.276196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:48:54.276261 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:48:54.276330 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:48:54.276397 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:48:54.276458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:48:54.276530 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:48:54.587888 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:49:11.783336 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:49:11.783421 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:49:11.783490 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:49:11.783555 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:49:11.783635 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:49:11.783698 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:49:11.783766 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:49:12.110295 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:49:21.925941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:49:21.926039 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:49:21.926115 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:49:21.926188 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:49:21.926247 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:49:21.926311 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:49:21.926374 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:49:22.248254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:49:24.854708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:49:24.854814 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:49:24.854884 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:49:24.854949 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:49:24.855937 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:49:24.856281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:49:24.857043 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:49:25.166102 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:49:52.509392 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:49:52.509508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:49:52.509577 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:49:52.509643 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:49:52.509710 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:49:52.509778 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:49:52.509846 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:49:52.816927 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:49:55.429155 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:49:55.429252 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:49:55.429332 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:49:55.429416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:49:55.429500 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:49:55.429581 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:49:55.429661 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:49:55.735028 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:50:11.905453 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:50:11.905544 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:50:11.905616 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:50:11.905685 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:50:11.905772 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:50:11.905848 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:50:11.905912 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:50:12.228236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:50:23.078468 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:50:23.078576 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:50:23.078641 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:50:23.078702 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:50:23.078767 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:50:23.078824 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:50:23.078892 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:50:23.386940 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:50:25.992709 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:50:25.992807 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:50:25.992886 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:50:25.992954 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:50:25.993020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:50:25.993079 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:50:25.993143 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:50:26.297818 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:50:53.651149 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:50:53.651264 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:50:53.651357 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:50:53.651436 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:50:53.651511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:50:53.651593 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:50:53.651680 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:50:53.955056 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:50:56.562475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:50:56.562580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:50:56.562663 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:50:56.562753 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:50:56.562832 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:50:56.562915 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:50:56.562988 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:50:56.865969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:51:12.028803 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:51:12.028885 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:51:12.028963 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:51:12.029030 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:51:12.029100 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:51:12.029166 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:51:12.029240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:51:12.351699 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:51:24.219598 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:51:24.219697 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:51:24.219765 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:51:24.219842 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:51:24.219908 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:51:24.219976 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:51:24.220044 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:51:24.524592 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:51:27.124660 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:51:27.124768 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:51:27.124848 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:51:27.124944 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:51:27.125029 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:51:27.125107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:51:27.125190 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:51:27.425469 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:51:54.788439 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:51:54.788528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:51:54.788619 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:51:54.788681 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:51:54.788768 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:51:54.788848 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:51:54.788932 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:51:55.101701 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:51:57.691593 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:51:57.691707 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:51:57.691809 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:51:57.691891 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:51:57.691968 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:51:57.692042 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:51:57.692111 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:51:58.000565 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:52:12.149869 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:52:12.149953 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:52:12.150024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:52:12.150098 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:52:12.150164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:52:12.150224 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:52:12.150289 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:52:12.459921 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:52:25.374464 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:52:25.374561 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:52:25.374630 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:52:25.374703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:52:25.374778 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:52:25.374843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:52:25.374906 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:52:25.681992 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:52:28.263696 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:52:28.263797 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:52:28.263864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:52:28.263931 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:52:28.263994 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:52:28.264065 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:52:28.264122 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:52:28.572265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:52:55.937019 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:52:55.937110 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:52:55.937179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:52:55.937245 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:52:55.937310 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:52:55.937377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:52:55.937442 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:52:56.244146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:52:58.836393 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:52:58.836512 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:52:58.836589 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:52:58.836659 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:52:58.836739 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:52:58.836806 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:52:58.836878 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:52:59.146247 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:53:12.276794 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:53:12.276877 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:53:12.276948 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:53:12.277015 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:53:12.277085 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:53:12.277151 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:53:12.277221 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:53:12.581974 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:53:26.510025 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:53:26.510154 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:53:26.510236 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:53:26.510319 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:53:26.510393 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:53:26.510480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:53:26.510552 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:53:26.812406 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:53:29.405253 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:53:29.405361 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:53:29.405432 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:53:29.405514 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:53:29.405612 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:53:29.405694 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:53:29.405776 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:53:29.705469 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:53:57.074911 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:53:57.075017 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:53:57.075101 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:53:57.075175 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:53:57.075258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:53:57.075333 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:53:57.075417 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:53:57.378198 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:53:59.962726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:53:59.962826 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:53:59.962899 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:53:59.962978 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:53:59.963050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:53:59.963123 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:53:59.963198 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:54:00.285314 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:54:12.401445 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:54:12.401800 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:54:12.402416 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:54:12.402543 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:54:12.402620 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:54:12.402732 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:54:12.402798 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:54:12.715650 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:54:27.633152 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:54:27.633238 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:54:27.633309 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:54:27.633380 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:54:27.633444 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:54:27.633513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:54:27.633589 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:54:27.940339 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:54:30.544786 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:54:30.544867 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:54:30.544936 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:54:30.545003 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:54:30.545069 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:54:30.545140 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:54:30.545204 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:54:30.855555 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:54:58.206849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:54:58.206937 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:54:58.206999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:54:58.207072 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:54:58.207147 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:54:58.207215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:54:58.207281 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:54:58.514594 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:55:01.116775 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:55:01.116860 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:55:01.116930 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:55:01.116994 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:55:01.117058 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:55:01.117121 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:55:01.117185 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:55:01.430260 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:55:12.524241 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:55:12.524322 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:55:12.524395 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:55:12.524457 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:55:12.524519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:55:12.524589 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:55:12.524654 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:55:12.840663 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:55:28.777308 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:55:28.777418 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:55:28.777488 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:55:28.777554 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:55:28.777618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:55:28.777681 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:55:28.777750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:55:29.083145 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:55:31.703058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:55:31.703175 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:55:31.703236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:55:31.703307 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:55:31.703371 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:55:31.703446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:55:31.703504 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:55:32.030735 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:55:59.347480 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:55:59.347569 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:55:59.347631 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:55:59.347701 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:55:59.347766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:55:59.347833 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:55:59.347893 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:55:59.654066 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:56:02.304143 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:56:02.304232 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:56:02.304309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:56:02.304374 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:56:02.304440 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:56:02.304512 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:56:02.304578 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:56:02.611384 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:56:12.644593 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:56:12.644702 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:56:12.644792 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:56:12.644865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:56:12.644944 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:56:12.645008 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:56:12.645097 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:56:12.960293 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:56:29.921747 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:56:29.921859 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:56:29.921955 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:56:29.922031 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:56:29.922099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:56:29.922173 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:56:29.922250 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:56:30.240669 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:56:32.876077 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:56:32.876174 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:56:32.876247 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:56:32.876320 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:56:32.876391 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:56:32.876467 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:56:32.876539 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:56:33.180403 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:57:00.502302 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:57:00.502403 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:57:00.502475 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:57:00.502543 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:57:00.502609 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:57:00.502674 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:57:00.502758 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:57:00.806346 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:57:03.437824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:57:03.437918 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:57:03.438019 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:57:03.438106 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:57:03.438190 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:57:03.438268 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:57:03.438353 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:57:03.740345 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:57:12.770991 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:57:12.771105 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:57:12.771179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:57:12.771260 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:57:12.771341 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:57:12.771433 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:57:12.771514 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:57:13.080539 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:57:31.075881 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:57:31.075983 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:57:31.076063 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:57:31.076146 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:57:31.076227 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:57:31.076309 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:57:31.076389 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:57:31.377115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:57:34.000979 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:57:34.001075 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:57:34.001168 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:57:34.001249 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:57:34.001319 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:57:34.001408 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:57:34.001494 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:57:34.304505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:58:01.634949 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:58:01.635062 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:58:01.635139 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:58:01.635207 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:58:01.635268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:58:01.635341 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:58:01.635407 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:58:01.954449 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:58:04.566033 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:58:04.566126 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:58:04.566196 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:58:04.566261 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:58:04.566322 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:58:04.566388 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:58:04.566452 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:58:04.878089 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:58:12.899152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:58:12.899238 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:58:12.899314 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:58:12.899385 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:58:12.899460 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:58:12.899523 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:58:12.899587 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:58:13.204579 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:58:32.236713 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:58:32.236822 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:58:32.236886 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:58:32.236955 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:58:32.237020 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:58:32.237085 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:58:32.237148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:58:32.542940 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:58:35.140961 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:58:35.141074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:58:35.141151 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:58:35.141216 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:58:35.141283 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:58:35.141344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:58:35.141408 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:58:35.450063 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:59:02.803197 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:59:02.803318 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:59:02.803381 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:59:02.803450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:59:02.803516 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:59:02.803583 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:59:02.803648 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:59:03.117579 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:59:05.709415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:59:05.709504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:59:05.709577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:59:05.709646 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:59:05.709712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:59:05.709786 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:59:05.709856 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:59:06.015700 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:59:13.023073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:59:13.023185 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:59:13.023270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:59:13.023350 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:59:13.023425 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:59:13.023501 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:59:13.023588 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:59:13.328371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:59:33.380616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:59:33.380726 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:59:33.380798 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:59:33.380867 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:59:33.380942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:59:33.381013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:59:33.381085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:59:33.697517 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 11:59:36.277405 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 11:59:36.277525 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 11:59:36.277592 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 11:59:36.277667 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 11:59:36.277740 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 11:59:36.277815 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 11:59:36.277878 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 11:59:36.582001 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:00:03.960960 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:00:03.961050 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:00:03.961130 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:00:03.961201 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:00:03.961262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:00:03.961328 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:00:03.961391 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:00:04.275891 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:00:06.837415 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:00:06.837496 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:00:06.837571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:00:06.837641 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:00:06.837710 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:00:06.837780 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:00:06.837849 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:00:07.144869 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:00:13.149255 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:00:13.149333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:00:13.149406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:00:13.149478 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:00:13.149541 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:00:13.149604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:00:13.149666 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:00:13.460894 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:00:34.538746 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:00:34.538841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:00:34.538909 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:00:34.538974 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:00:34.539042 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:00:34.539104 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:00:34.539165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:00:34.848342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:00:37.405193 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:00:37.405276 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:00:37.405348 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:00:37.405419 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:00:37.405482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:00:37.405553 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:00:37.405619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:00:37.715537 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:01:05.109401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:01:05.109528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:01:05.109604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:01:05.109674 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:01:05.109751 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:01:05.109821 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:01:05.109901 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:01:05.416645 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:01:07.980840 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:01:07.980992 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:01:07.981159 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:01:07.981301 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:01:07.981438 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:01:07.981552 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:01:07.981942 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:01:08.287285 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:01:13.275080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:01:13.275167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:01:13.275245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:01:13.275317 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:01:13.275386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:01:13.275456 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:01:13.275521 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:01:13.588878 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:01:35.676515 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:01:35.676617 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:01:35.676682 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:01:35.676762 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:01:35.676834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:01:35.676898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:01:35.676960 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:01:35.986341 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:01:38.557210 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:01:38.557312 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:01:38.557373 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:01:38.557441 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:01:38.557506 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:01:38.557573 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:01:38.557631 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:01:38.867078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:02:06.251073 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:02:06.251153 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:02:06.251225 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:02:06.251289 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:02:06.251355 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:02:06.251417 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:02:06.251482 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:02:06.559660 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:02:09.131738 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:02:09.131839 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:02:09.131907 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:02:09.131970 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:02:09.132039 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:02:09.132104 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:02:09.132170 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:02:09.441358 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:02:13.403852 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:02:13.403959 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:02:13.404056 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:02:13.404207 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:02:13.404300 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:02:13.404391 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:02:13.404480 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:02:13.708116 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:02:36.828534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:02:36.828636 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:02:36.828724 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:02:36.828817 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:02:36.828897 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:02:36.828981 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:02:36.829066 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:02:37.127585 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:02:39.698969 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:02:39.699061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:02:39.699143 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:02:39.699219 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:02:39.699295 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:02:39.699359 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:02:39.699436 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:02:40.014213 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:03:07.386616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:03:07.386713 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:03:07.386825 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:03:07.386906 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:03:07.386985 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:03:07.387064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:03:07.387142 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:03:07.688378 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:03:10.278789 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:03:10.278908 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:03:10.278988 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:03:10.279078 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:03:10.279165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:03:10.279243 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:03:10.279322 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:03:10.575386 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:03:13.535450 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:03:13.535546 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:03:13.535615 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:03:13.535683 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:03:13.535762 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:03:13.535829 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:03:13.535891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:03:13.840707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:03:37.942989 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:03:37.943106 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:03:37.943166 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:03:37.943235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:03:37.943297 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:03:37.943359 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:03:37.943421 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:03:38.246741 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:03:40.834052 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:03:40.834151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:03:40.834227 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:03:40.834305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:03:40.834379 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:03:40.834453 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:03:40.834532 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:03:41.141175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:04:08.509621 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:04:08.509728 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:04:08.509803 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:04:08.509890 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:04:08.509960 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:04:08.510031 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:04:08.510101 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:04:08.812387 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:04:11.411752 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:04:11.411838 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:04:11.411911 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:04:11.411977 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:04:11.412040 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:04:11.412106 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:04:11.412172 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:04:11.713994 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:04:13.658906 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:04:13.659000 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:04:13.659071 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:04:13.659168 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:04:13.659234 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:04:13.659300 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:04:13.659366 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:04:13.974571 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:04:39.077726 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:04:39.077851 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:04:39.077922 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:04:39.077989 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:04:39.078051 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:04:39.078123 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:04:39.078189 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:04:39.388989 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:04:41.982212 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:04:41.982297 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:04:41.982364 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:04:41.982434 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:04:41.982500 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:04:41.982564 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:04:41.982626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:04:42.312126 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:05:09.649626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:05:09.649710 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:05:09.649784 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:05:09.649848 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:05:09.649917 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:05:09.649984 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:05:09.650050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:05:09.961941 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:05:12.575175 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:05:12.575282 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:05:12.575347 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:05:12.575418 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:05:12.575479 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:05:12.575540 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:05:12.575601 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:05:12.875568 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:05:13.783858 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:05:13.783944 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:05:13.784018 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:05:13.784089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:05:13.784154 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:05:13.784228 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:05:13.784295 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:05:14.096149 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:05:40.224053 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:05:40.224139 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:05:40.224207 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:05:40.224289 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:05:40.224353 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:05:40.224423 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:05:40.224489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:05:40.525162 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:05:43.145535 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:05:43.145632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:05:43.145715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:05:43.145822 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:05:43.145903 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:05:43.145979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:05:43.146052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:05:43.441672 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:06:10.793632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:06:10.793728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:06:10.793792 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:06:10.793864 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:06:10.793926 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:06:10.793992 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:06:10.794059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:06:11.109891 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:06:13.695306 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:06:13.695418 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:06:13.695497 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:06:13.695573 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:06:13.695654 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:06:13.695740 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:06:13.695824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:06:14.003435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:06:14.269759 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:06:14.269861 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:06:14.269935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:06:14.270019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:06:14.270094 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:06:14.270179 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:06:14.270251 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:06:14.574833 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:06:41.373118 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:06:41.373213 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:06:41.373281 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:06:41.373362 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:06:41.373436 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:06:41.373496 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:06:41.373571 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:06:41.684627 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:06:44.271404 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:06:44.271507 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:06:44.271572 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:06:44.271640 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:06:44.271705 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:06:44.271768 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:06:44.271838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:06:44.577974 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:07:11.950494 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:07:11.950589 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:07:11.950662 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:07:11.950740 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:07:11.950810 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:07:11.950873 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:07:11.950935 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:07:12.255525 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:07:14.035279 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:07:14.035367 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:07:14.035433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:07:14.035494 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:07:14.035555 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:07:14.035617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:07:14.035680 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:07:14.339621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:07:14.852292 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:07:14.852379 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:07:14.852449 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:07:14.852513 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:07:14.852581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:07:14.852640 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:07:14.852706 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:07:15.159792 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:07:42.517487 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:07:42.517571 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:07:42.517635 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:07:42.517703 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:07:42.517773 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:07:42.517841 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:07:42.517903 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:07:42.824826 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:07:45.423639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:07:45.423744 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:07:45.423812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:07:45.423879 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:07:45.423944 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:07:45.424008 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:07:45.424080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:07:45.723558 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:08:13.086295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:08:13.086397 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:08:13.086481 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:08:13.086564 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:08:13.086633 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:08:13.086708 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:08:13.086797 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:08:13.390619 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:08:14.170151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:08:14.170247 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:08:14.170314 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:08:14.170380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:08:14.170455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:08:14.170521 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:08:14.170587 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:08:14.473981 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:08:15.982507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:08:15.982612 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:08:15.982677 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:08:15.982755 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:08:15.982818 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:08:15.982881 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:08:15.982939 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:08:16.288815 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:08:43.645563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:08:43.645665 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:08:43.645740 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:08:43.645812 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:08:43.645877 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:08:43.645938 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:08:43.646002 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:08:43.959474 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:08:46.552835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:08:46.552937 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:08:46.553004 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:08:46.553075 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:08:46.553140 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:08:46.553197 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:08:46.553267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:08:46.852087 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:09:14.231068 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:09:14.231171 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:09:14.231247 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:09:14.231325 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:09:14.231401 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:09:14.231485 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:09:14.231571 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:09:14.541253 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:09:14.803059 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:09:14.803152 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:09:14.803223 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:09:14.803297 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:09:14.803364 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:09:14.803433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:09:14.803496 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:09:15.106075 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:09:17.114107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:09:17.114206 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:09:17.114285 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:09:17.114369 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:09:17.114446 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:09:17.114524 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:09:17.114605 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:09:17.418632 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:09:44.801643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:09:44.801760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:09:44.801833 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:09:44.801908 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:09:44.801986 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:09:44.802055 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:09:44.802127 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:09:45.109816 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:09:47.686140 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:09:47.686246 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:09:47.686307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:09:47.686376 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:09:47.686444 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:09:47.686507 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:09:47.686575 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:09:48.020324 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:10:14.425901 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:10:14.425984 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:10:14.426060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:10:14.426123 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:10:14.426189 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:10:14.426258 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:10:14.426323 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:10:14.740015 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:10:15.378230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:10:15.378351 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:10:15.378436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:10:15.378511 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:10:15.378598 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:10:15.378675 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:10:15.378755 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:10:15.675961 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:10:18.284592 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:10:18.284990 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:10:18.285161 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:10:18.285907 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:10:18.286024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:10:18.286107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:10:18.286194 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:10:18.596887 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:10:45.933043 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:10:45.933147 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:10:45.933224 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:10:45.933292 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:10:45.933367 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:10:45.933433 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:10:45.933506 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:10:46.241381 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:10:48.854210 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:10:48.854291 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:10:48.854356 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:10:48.854415 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:10:48.854489 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:10:48.854550 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:10:48.854620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:10:49.168686 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:11:14.552617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:11:14.552699 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:11:14.552781 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:11:14.552854 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:11:14.552915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:11:14.552981 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:11:14.553050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:11:14.863294 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:11:16.502216 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:11:16.502320 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:11:16.502380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:11:16.502449 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:11:16.502513 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:11:16.502576 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:11:16.502639 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:11:16.811800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:11:19.443009 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:11:19.443109 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:11:19.443175 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:11:19.443248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:11:19.443309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:11:19.443373 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:11:19.443441 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:11:19.750958 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:11:47.073905 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:11:47.073988 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:11:47.074060 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:11:47.074123 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:11:47.074195 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:11:47.074256 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:11:47.074332 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:11:47.374341 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:11:50.019097 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:11:50.019218 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:11:50.019291 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:11:50.019360 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:11:50.019433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:11:50.019496 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:11:50.019560 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:11:50.343626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:12:14.678865 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:12:14.678946 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:12:14.679013 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:12:14.679079 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:12:14.679152 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:12:14.679219 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:12:14.679289 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:12:14.979982 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:12:17.631502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:12:17.631600 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:12:17.631677 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:12:17.631772 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:12:17.631861 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:12:17.631948 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:12:17.632041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:12:17.947182 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:12:20.606614 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:12:20.606762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:12:20.606843 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:12:20.606928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:12:20.607003 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:12:20.607090 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:12:20.607162 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:12:20.917432 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:12:48.216293 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:12:48.216402 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:12:48.216479 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:12:48.216549 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:12:48.216632 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:12:48.216697 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:12:48.216771 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:12:48.526345 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:12:51.175762 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:12:51.175867 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:12:51.175946 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:12:51.176029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:12:51.176110 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:12:51.176190 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:12:51.176265 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:12:51.483509 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:13:14.808417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:13:14.808495 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:13:14.808573 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:13:14.808649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:13:14.808726 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:13:14.808798 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:13:14.808873 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:13:15.112835 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:13:18.788899 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:13:18.788984 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:13:18.789056 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:13:18.789120 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:13:18.789185 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:13:18.789250 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:13:18.789319 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:13:19.092389 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:13:21.747453 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:13:21.747546 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:13:21.747619 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:13:21.747685 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:13:21.747764 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:13:21.747834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:13:21.747896 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:13:22.071523 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:13:49.354761 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:13:49.355756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:13:49.355987 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:13:49.356409 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:13:49.357102 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:13:49.357594 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:13:49.358234 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:13:49.660174 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:13:52.355285 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:13:52.355372 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:13:52.355437 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:13:52.355501 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:13:52.355571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:13:52.355632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:13:52.355706 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:13:52.656937 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:14:14.940414 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:14:14.940494 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:14:14.940563 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:14:14.940626 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:14:14.940694 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:14:14.940772 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:14:14.940840 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:14:15.245451 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:14:19.928261 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:14:19.928337 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:14:19.928407 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:14:19.928474 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:14:19.928540 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:14:19.928603 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:14:19.928665 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:14:20.249272 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:14:22.918403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:14:22.918491 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:14:22.918559 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:14:22.918626 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:14:22.918687 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:14:22.918761 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:14:22.918820 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:14:23.218794 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:14:50.509310 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:14:50.509401 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:14:50.509466 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:14:50.509534 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:14:50.509595 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:14:50.509661 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:14:50.509734 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:14:50.817308 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:14:53.479160 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:14:53.479251 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:14:53.479324 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:14:53.479405 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:14:53.479469 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:14:53.479550 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:14:53.479611 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:14:53.791203 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:15:15.072132 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:15:15.072232 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:15:15.072301 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:15:15.072371 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:15:15.072438 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:15:15.072504 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:15:15.072568 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:15:15.375689 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:15:21.080213 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:15:21.080315 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:15:21.080382 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:15:21.080448 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:15:21.080515 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:15:21.080575 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:15:21.080637 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:15:21.380974 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:15:24.049083 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:15:24.049187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:15:24.049253 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:15:24.049320 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:15:24.049383 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:15:24.049451 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:15:24.049512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:15:24.352352 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:15:51.636294 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:15:51.636394 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:15:51.636465 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:15:51.636529 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:15:51.636594 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:15:51.636657 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:15:51.636727 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:15:51.944455 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:15:54.610936 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:15:54.611024 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:15:54.611092 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:15:54.611159 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:15:54.611227 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:15:54.611288 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:15:54.611346 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:15:54.913468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:16:15.197004 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:16:15.197080 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:16:15.197153 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:16:15.197220 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:16:15.197288 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:16:15.197354 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:16:15.197417 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:16:15.503668 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:16:22.229700 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:16:22.229818 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:16:22.229881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:16:22.229949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:16:22.230009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:16:22.230073 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:16:22.230141 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:16:22.533414 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:16:25.182568 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:16:25.182654 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:16:25.182730 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:16:25.182799 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:16:25.182864 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:16:25.182931 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:16:25.182998 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:16:25.485524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:16:52.798410 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:16:52.798494 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:16:52.798568 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:16:52.798629 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:16:52.798704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:16:52.798829 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:16:52.798895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:16:53.104515 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:16:55.749793 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:16:55.749908 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:16:55.749992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:16:55.750071 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:16:55.750154 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:16:55.750235 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:16:55.750316 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:16:56.057338 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:17:15.327311 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:17:15.327405 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:17:15.327524 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:17:15.327615 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:17:15.327681 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:17:15.327767 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:17:15.327841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:17:15.634570 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:17:23.370840 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:17:23.370949 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:17:23.371013 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:17:23.371077 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:17:23.371143 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:17:23.371205 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:17:23.371279 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:17:23.677222 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:17:26.313942 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:17:26.314049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:17:26.314119 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:17:26.314184 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:17:26.314250 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:17:26.314310 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:17:26.314375 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:17:26.616390 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:17:53.942628 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:17:53.942715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:17:53.942792 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:17:53.942855 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:17:53.942919 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:17:53.942983 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:17:53.943051 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:17:54.251327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:17:56.886680 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:17:56.886775 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:17:56.886859 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:17:56.886925 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:17:56.886986 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:17:56.887053 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:17:56.887122 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:17:57.186742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:18:15.449151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:18:15.449235 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:18:15.449297 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:18:15.449372 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:18:15.449434 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:18:15.449502 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:18:15.449568 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:18:15.753874 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:18:24.521935 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:18:24.522027 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:18:24.522095 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:18:24.522165 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:18:24.522233 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:18:24.522305 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:18:24.522379 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:18:24.828074 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:18:27.449255 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:18:27.449357 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:18:27.449423 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:18:27.449492 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:18:27.449558 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:18:27.449623 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:18:27.449690 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:18:27.748861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:18:55.086084 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:18:55.086175 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:18:55.086249 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:18:55.086321 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:18:55.086384 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:18:55.086448 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:18:55.086513 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:18:55.393027 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:18:58.008703 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:18:58.008809 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:18:58.008899 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:18:58.008971 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:18:58.009035 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:18:58.009096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:18:58.009163 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:18:58.308904 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:19:15.579527 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:19:15.579613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:19:15.579691 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:19:15.579772 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:19:15.579835 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:19:15.579893 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:19:15.579957 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:19:15.887317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:19:25.650778 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:19:25.650873 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:19:25.650936 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:19:25.651013 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:19:25.651071 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:19:25.651134 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:19:25.651199 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:19:25.961471 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:19:28.570455 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:19:28.570580 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:19:28.571647 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:19:28.572323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:19:28.572979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:19:28.573656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:19:28.573752 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:19:28.883391 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:19:56.225594 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:19:56.225732 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:19:56.225812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:19:56.225897 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:19:56.225984 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:19:56.226070 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:19:56.226152 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:19:56.540816 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:19:59.141481 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:19:59.141578 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:19:59.141669 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:19:59.141748 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:19:59.141832 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:19:59.141904 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:19:59.141987 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:19:59.455513 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:20:15.707604 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:20:15.707712 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:20:15.707801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:20:15.707876 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:20:15.707949 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:20:15.708018 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:20:15.708107 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:20:16.017872 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:20:26.810183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:20:26.810284 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:20:26.810369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:20:26.810438 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:20:26.810510 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:20:26.810578 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:20:26.810653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:20:27.118370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:20:29.725277 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:20:29.725365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:20:29.725434 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:20:29.725503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:20:29.725566 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:20:29.725645 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:20:29.725715 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:20:30.041742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:20:57.379946 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:20:57.380055 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:20:57.380127 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:20:57.380193 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:20:57.380259 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:20:57.380320 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:20:57.380388 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:20:57.686157 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:21:00.307953 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:21:00.308070 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:21:00.308140 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:21:00.308209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:21:00.308280 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:21:00.308342 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:21:00.308408 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:21:00.614820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:21:15.835023 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:21:15.835099 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:21:15.835166 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:21:15.835235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:21:15.835305 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:21:15.835367 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:21:15.835437 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:21:16.147149 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:21:27.945576 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:21:27.945663 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:21:27.945729 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:21:27.945810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:21:27.945879 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:21:27.945950 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:21:27.946013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:21:28.247862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:21:30.874431 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:21:30.874523 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:21:30.874587 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:21:30.874662 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:21:30.874729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:21:30.874796 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:21:30.874857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:21:31.189008 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:21:58.508164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:21:58.508273 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:21:58.508361 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:21:58.508472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:21:58.508539 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:21:58.508602 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:21:58.508661 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:21:58.821563 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:22:01.446655 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:22:01.446754 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:22:01.446844 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:22:01.446909 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:22:01.446974 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:22:01.447037 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:22:01.447101 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:22:01.753549 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:22:15.958668 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:22:15.958762 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:22:15.958836 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:22:15.958901 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:22:15.958964 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:22:15.959034 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:22:15.959089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:22:16.262003 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:22:29.089221 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:22:29.089306 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:22:29.089387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:22:29.089452 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:22:29.089514 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:22:29.089567 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:22:29.089632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:22:29.394648 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:22:32.017258 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:22:32.017355 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:22:32.017419 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:22:32.017482 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:22:32.017549 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:22:32.017615 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:22:32.017674 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:22:32.340388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:22:59.660854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:22:59.660939 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:22:59.661020 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:22:59.661082 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:22:59.661151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:22:59.661223 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:22:59.661286 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:22:59.967261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:23:02.604653 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:23:02.604747 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:23:02.604816 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:23:02.604883 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:23:02.604949 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:23:02.605008 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:23:02.605074 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:23:02.907975 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:23:16.091035 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:23:16.091139 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:23:16.091198 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:23:16.091267 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:23:16.091331 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:23:16.091393 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:23:16.091460 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:23:16.401829 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:23:30.241867 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:23:30.241966 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:23:30.242035 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:23:30.242102 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:23:30.242169 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:23:30.242235 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:23:30.242315 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:23:30.544969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:23:33.171997 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:23:33.172088 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:23:33.172154 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:23:33.172214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:23:33.172281 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:23:33.172345 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:23:33.172411 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:23:33.479092 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:24:00.803942 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:24:00.804023 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:24:00.804096 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:24:00.804156 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:24:00.804219 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:24:00.804281 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:24:00.804344 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:24:01.111050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:24:03.751345 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:24:03.751433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:24:03.751510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:24:03.751616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:24:03.751683 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:24:03.751753 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:24:03.751816 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:24:04.057448 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:24:16.220550 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:24:16.220631 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:24:16.220694 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:24:16.220766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:24:16.220830 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:24:16.220895 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:24:16.220960 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:24:16.526891 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:24:31.371219 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:24:31.371296 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:24:31.371377 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:24:31.371440 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:24:31.371505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:24:31.371563 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:24:31.371625 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:24:31.682556 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:24:34.325004 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:24:34.325087 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:24:34.325154 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:24:34.325216 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:24:34.325286 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:24:34.325347 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:24:34.325408 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:24:34.634334 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:25:01.950767 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:25:01.950857 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:25:01.950928 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:25:01.950990 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:25:01.951066 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:25:01.951124 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:25:01.951187 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:25:02.286892 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:25:04.906373 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:25:04.906465 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:25:04.906533 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:25:04.906594 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:25:04.906655 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:25:04.906724 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:25:04.906792 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:25:05.214657 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:25:16.354959 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:25:16.355061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:25:16.355147 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:25:16.355267 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:25:16.355357 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:25:16.355451 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:25:16.355538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:25:16.661124 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:25:32.551557 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:25:32.551656 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:25:32.551741 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:25:32.551845 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:25:32.551949 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:25:32.552024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:25:32.552118 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:25:32.857656 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:25:35.476873 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:25:35.476959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:25:35.477025 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:25:35.477088 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:25:35.477156 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:25:35.477223 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:25:35.477286 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:25:35.781695 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:26:03.127192 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:26:03.127351 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:26:03.127451 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:26:03.127544 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:26:03.127644 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:26:03.127751 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:26:03.127849 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:26:03.438513 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:26:06.043212 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:26:06.043300 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:26:06.043361 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:26:06.043425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:26:06.043490 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:26:06.043569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:26:06.043623 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:26:06.350913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:26:16.476811 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:26:16.476883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:26:16.476950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:26:16.477016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:26:16.477078 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:26:16.477137 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:26:16.477205 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:26:16.781041 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:26:33.701342 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:26:33.701425 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:26:33.701493 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:26:33.701560 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:26:33.701624 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:26:33.701691 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:26:33.701761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:26:34.012112 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:26:36.609470 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:26:36.609550 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:26:36.609618 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:26:36.609689 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:26:36.609766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:26:36.609836 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:26:36.609898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:26:36.916389 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:27:04.280861 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:27:04.280943 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:27:04.281018 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:27:04.281086 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:27:04.281150 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:27:04.281216 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:27:04.281276 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:27:04.591409 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:27:07.179708 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:27:07.179806 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:27:07.179885 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:27:07.179952 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:27:07.180017 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:27:07.180080 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:27:07.180151 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:27:07.484896 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:27:16.604386 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:27:16.604471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:27:16.604537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:27:16.604597 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:27:16.604661 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:27:16.604728 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:27:16.604792 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:27:16.911711 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:27:34.858598 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:27:34.858674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:27:34.858745 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:27:34.858805 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:27:34.858867 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:27:34.858926 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:27:34.858986 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:27:35.160917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:27:37.741623 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:27:37.741701 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:27:37.741787 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:27:37.741849 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:27:37.741912 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:27:37.741971 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:27:37.742037 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:27:38.041436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:28:05.417143 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:28:05.417242 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:28:05.417320 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:28:05.417385 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:28:05.417445 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:28:05.417510 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:28:05.417570 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:28:05.729425 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:28:08.301549 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:28:08.301633 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:28:08.301701 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:28:08.301770 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:28:08.301835 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:28:08.301902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:28:08.301957 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:28:08.608009 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:28:16.730979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:28:16.731071 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:28:16.731152 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:28:16.731220 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:28:16.731291 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:28:16.731357 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:28:16.731424 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:28:17.040010 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:28:35.988021 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:28:35.988110 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:28:35.988174 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:28:35.988239 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:28:35.988313 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:28:35.988377 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:28:35.988439 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:28:36.293229 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:28:38.875298 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:28:38.875391 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:28:38.875462 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:28:38.875527 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:28:38.875588 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:28:38.875648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:28:38.875708 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:28:39.185388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:29:06.555701 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:29:06.555813 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:29:06.555879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:29:06.555941 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:29:06.556009 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:29:06.556069 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:29:06.556136 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:29:06.865491 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:29:09.450021 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:29:09.450106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:29:09.450182 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:29:09.450250 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:29:09.450317 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:29:09.450379 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:29:09.450444 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:29:09.766083 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:29:16.853409 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:29:16.853502 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:29:16.853566 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:29:16.853630 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:29:16.853695 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:29:16.853769 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:29:16.853828 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:29:17.162096 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:29:37.133668 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:29:37.133779 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:29:37.133845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:29:37.133915 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:29:37.133976 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:29:37.134036 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:29:37.134100 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:29:37.448127 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:29:40.033635 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:29:40.033728 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:29:40.033805 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:29:40.033866 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:29:40.033931 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:29:40.033996 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:29:40.034056 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:29:40.352495 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:30:07.710310 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:30:07.710392 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:30:07.710458 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:30:07.710521 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:30:07.710589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:30:07.710654 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:30:07.710728 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:30:08.036986 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:30:10.626493 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:30:10.626600 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:30:10.626677 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:30:10.626763 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:30:10.626843 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:30:10.626918 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:30:10.626998 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:30:10.937265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:30:16.981746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:30:16.981839 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:30:16.981918 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:30:16.981995 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:30:16.982066 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:30:16.982139 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:30:16.982212 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:30:17.285734 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:30:38.299851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:30:38.299970 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:30:38.300034 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:30:38.300100 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:30:38.300158 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:30:38.300234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:30:38.300291 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:30:38.610244 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:30:41.196290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:30:41.196378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:30:41.196449 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:30:41.196513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:30:41.196582 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:30:41.196641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:30:41.196707 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:30:41.513982 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:31:08.875087 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:31:08.875196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:31:08.875266 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:31:08.875332 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:31:08.875404 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:31:08.875473 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:31:08.875542 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:31:09.186565 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:31:11.792307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:31:11.792396 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:31:11.792460 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:31:11.792531 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:31:11.792594 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:31:11.792658 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:31:11.792732 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:31:12.127337 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:31:17.104710 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:31:17.104820 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:31:17.104898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:31:17.104964 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:31:17.105043 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:31:17.105114 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:31:17.105180 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:31:17.407096 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:31:39.447140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:31:39.447220 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:31:39.447290 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:31:39.447355 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:31:39.447418 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:31:39.447485 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:31:39.447555 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:31:39.754545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:31:42.382957 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:31:42.383041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:31:42.383116 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:31:42.383180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:31:42.383244 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:31:42.383312 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:31:42.383379 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:31:42.699403 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:32:10.023812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:32:10.023912 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:32:10.023999 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:32:10.024082 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:32:10.024168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:32:10.024253 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:32:10.024337 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:32:10.336173 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:32:12.960289 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:32:12.960379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:32:12.960460 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:32:12.960529 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:32:12.960599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:32:12.960671 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:32:12.960775 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:32:13.270214 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:32:17.228533 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:32:17.228645 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:32:17.228732 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:32:17.228805 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:32:17.228892 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:32:17.228982 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:32:17.229071 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:32:17.530766 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:32:40.601079 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:32:40.601190 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:32:40.601269 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:32:40.601343 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:32:40.601416 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:32:40.601483 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:32:40.601546 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:32:40.903336 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:32:43.534342 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:32:43.534448 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:32:43.534529 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:32:43.534608 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:32:43.534680 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:32:43.534773 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:32:43.534847 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:32:43.841952 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:33:11.167427 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:33:11.167609 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:33:11.167785 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:33:11.167942 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:33:11.168081 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:33:11.168222 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:33:11.168369 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:33:11.475609 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:33:14.109265 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:33:14.109351 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:33:14.109423 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:33:14.109490 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:33:14.109552 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:33:14.109616 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:33:14.109675 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:33:14.426922 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:33:17.350713 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:33:17.350796 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:33:17.350862 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:33:17.350930 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:33:17.350987 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:33:17.351050 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:33:17.351114 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:33:17.662295 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:33:41.739486 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:33:41.739617 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:33:41.739687 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:33:41.739756 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:33:41.739822 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:33:41.739887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:33:41.739951 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:33:42.050772 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:33:44.693422 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:33:44.693537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:33:44.693613 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:33:44.693686 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:33:44.693779 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:33:44.693848 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:33:44.693924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:33:44.997008 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:34:12.330341 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:34:12.330427 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:34:12.330501 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:34:12.330571 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:34:12.330633 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:34:12.330700 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:34:12.330768 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:34:12.637930 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:34:15.258194 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:34:15.258277 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:34:15.258336 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:34:15.258401 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:34:15.258466 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:34:15.258528 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:34:15.258613 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:34:15.558931 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:34:17.477155 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:34:17.477228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:34:17.477295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:34:17.477355 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:34:17.477415 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:34:17.477479 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:34:17.477538 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:34:17.800785 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:34:42.909404 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:34:42.909519 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:34:42.909601 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:34:42.909667 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:34:42.909748 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:34:42.909822 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:34:42.909899 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:34:43.219136 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:34:45.821541 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:34:45.821636 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:34:45.821703 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:34:45.821797 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:34:45.821864 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:34:45.821923 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:34:45.821985 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:34:46.125946 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:35:13.479422 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:35:13.479516 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:35:13.479581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:35:13.479645 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:35:13.479708 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:35:13.479779 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:35:13.479838 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:35:13.784997 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:35:16.384592 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:35:16.384678 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:35:16.384764 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:35:16.384831 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:35:16.384899 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:35:16.384969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:35:16.385032 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:35:16.690362 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:35:17.598105 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:35:17.598189 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:35:17.598255 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:35:17.598316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:35:17.598862 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:35:17.599335 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:35:17.599483 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:35:17.919265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:35:44.050062 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:35:44.050157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:35:44.050222 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:35:44.050283 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:35:44.050348 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:35:44.050407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:35:44.050473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:35:44.356278 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:35:46.955284 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:35:46.955365 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:35:46.955440 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:35:46.955502 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:35:46.955562 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:35:46.955625 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:35:46.955682 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:35:47.258759 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:36:14.627227 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:36:14.627312 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:36:14.627392 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:36:14.627462 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:36:14.627529 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:36:14.627595 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:36:14.627660 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:36:14.940031 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:36:17.518491 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:36:17.518575 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:36:17.518635 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:36:17.518703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:36:17.518780 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:36:17.518855 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:36:17.518915 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:36:17.839066 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:36:18.105505 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:36:18.105586 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:36:18.105664 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:36:18.105735 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:36:18.105806 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:36:18.105866 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:36:18.105931 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:36:18.412326 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:36:45.203793 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:36:45.203884 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:36:45.203956 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:36:45.204593 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:36:45.205158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:36:45.205387 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:36:45.206369 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:36:45.521042 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:36:48.105999 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:36:48.106080 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:36:48.106166 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:36:48.106233 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:36:48.106298 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:36:48.106365 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:36:48.106430 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:36:48.411980 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:37:15.797776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:37:15.797863 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:37:15.797934 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:37:15.798005 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:37:15.798067 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:37:15.798139 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:37:15.798198 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:37:16.100809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:37:17.837348 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:37:17.837430 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:37:17.837501 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:37:17.837570 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:37:17.837633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:37:17.837698 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:37:17.837766 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:37:18.137148 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:37:18.674325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:37:18.674413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:37:18.674475 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:37:18.674536 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:37:18.674600 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:37:18.674666 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:37:18.674733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:37:18.980144 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:37:46.359848 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:37:46.359932 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:37:46.359993 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:37:46.360062 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:37:46.360129 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:37:46.361072 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:37:46.361297 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:37:46.663101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:37:49.247217 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:37:49.247325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:37:49.247390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:37:49.247453 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:37:49.247516 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:37:49.247583 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:37:49.247647 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:37:49.553163 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:38:16.922215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:38:16.922292 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:38:16.922367 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:38:16.922430 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:38:16.922493 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:38:16.922557 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:38:16.922622 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:38:17.225154 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:38:17.961021 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:38:17.961115 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:38:17.961192 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:38:17.961259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:38:17.961321 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:38:17.961381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:38:17.961441 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:38:18.265295 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:38:19.821524 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:38:19.821614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:38:19.821673 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:38:19.821751 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:38:19.821814 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:38:19.821879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:38:19.821941 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:38:20.135692 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:38:47.485644 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:38:47.485741 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:38:47.485818 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:38:47.485883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:38:47.485956 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:38:47.486016 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:38:47.486083 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:38:47.795913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:38:50.399204 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:38:50.399291 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:38:50.399354 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:38:50.399425 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:38:50.399494 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:38:50.399562 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:38:50.399627 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:38:50.703425 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:39:18.056399 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:39:18.056481 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:39:18.056541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:39:18.056611 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:39:18.056673 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:39:18.056744 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:39:18.056809 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:39:18.365576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:39:18.629952 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:39:18.630040 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:39:18.630108 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:39:18.630175 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:39:18.630243 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:39:18.630309 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:39:18.630376 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:39:18.941143 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:39:20.965446 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:39:20.965540 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:39:20.965615 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:39:20.965681 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:39:20.965745 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:39:20.965813 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:39:20.965870 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:39:21.271104 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:39:48.630913 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:39:48.631004 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:39:48.631072 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:39:48.631136 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:39:48.631197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:39:48.631268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:39:48.631328 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:39:48.939830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:39:51.529948 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:39:51.530029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:39:51.530103 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:39:51.530168 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:39:51.530233 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:39:51.530299 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:39:51.530364 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:39:51.847242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:40:18.208057 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:40:18.208139 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:40:18.208195 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:40:18.208255 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:40:18.208318 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:40:18.208376 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:40:18.208437 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:40:18.515596 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:40:19.203768 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:40:19.203859 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:40:19.203923 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:40:19.203988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:40:19.204049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:40:19.204113 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:40:19.204169 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:40:19.501893 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:40:22.117667 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:40:22.117769 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:40:22.117844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:40:22.117916 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:40:22.117996 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:40:22.118064 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:40:22.118138 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:40:22.423613 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:40:49.764464 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:40:49.764559 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:40:49.764620 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:40:49.764690 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:40:49.764758 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:40:49.764827 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:40:49.764893 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:40:50.083678 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:40:52.689123 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:40:52.689218 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:40:52.689301 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:40:52.689384 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:40:52.689467 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:40:52.689551 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:40:52.689628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:40:53.002537 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:41:18.326935 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:41:18.327056 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:41:18.327134 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:41:18.327206 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:41:18.327287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:41:18.327380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:41:18.327461 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:41:18.630144 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:41:20.348894 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:41:20.348989 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:41:20.349076 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:41:20.349159 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:41:20.349234 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:41:20.349319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:41:20.349394 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:41:20.651790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:41:23.262608 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:41:23.262728 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:41:23.262808 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:41:23.262885 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:41:23.262970 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:41:23.263047 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:41:23.263130 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:41:23.570529 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:41:50.918102 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:41:50.918185 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:41:50.918259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:41:50.918329 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:41:50.918396 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:41:50.918465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:41:50.918535 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:41:51.225944 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:41:53.832414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:41:53.832497 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:41:53.832561 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:41:53.832622 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:41:53.832688 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:41:53.832755 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:41:53.832837 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:41:54.131679 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:42:18.449490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:42:18.449565 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:42:18.449640 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:42:18.449701 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:42:18.449771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:42:18.449836 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:42:18.449899 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:42:18.758443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:42:21.487767 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:42:21.488385 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:42:21.488939 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:42:21.489149 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:42:21.489503 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:42:21.490216 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:42:21.490319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:42:21.822292 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:42:24.403879 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:42:24.403959 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:42:24.404025 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:42:24.404094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:42:24.404162 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:42:24.404225 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:42:24.404290 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:42:24.707198 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:42:52.099365 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:42:52.099461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:42:52.099535 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:42:52.099610 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:42:52.099682 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:42:52.099767 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:42:52.099839 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:42:52.414341 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:42:54.967571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:42:54.967648 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:42:54.967711 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:42:54.967778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:42:54.967845 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:42:54.967902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:42:54.967965 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:42:55.281208 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:43:18.570197 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:43:18.570278 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:43:18.570344 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:43:18.570413 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:43:18.570471 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:43:18.570537 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:43:18.570596 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:43:18.878090 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:43:22.677112 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:43:22.677203 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:43:22.677272 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:43:22.677343 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:43:22.677405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:43:22.677475 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:43:22.677530 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:43:22.980139 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:43:25.541315 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:43:25.541417 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:43:25.541484 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:43:25.541549 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:43:25.541610 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:43:25.541678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:43:25.542680 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:43:25.854659 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:43:53.238812 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:43:53.238896 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:43:53.238960 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:43:53.239025 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:43:53.239089 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:43:53.239151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:43:53.239220 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:43:53.547626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:43:56.116067 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:43:56.116154 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:43:56.116228 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:43:56.116291 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:43:56.116350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:43:56.116413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:43:56.116472 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:43:56.421592 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:44:18.687890 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:44:18.687970 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:44:18.688038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:44:18.688103 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:44:18.688161 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:44:18.688221 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:44:18.688288 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:44:18.999320 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:44:23.806184 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:44:23.806263 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:44:23.806341 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:44:23.806401 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:44:23.806462 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:44:23.806524 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:44:23.806585 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:44:24.117881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:44:26.685689 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:44:26.685787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:44:26.685861 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:44:26.685938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:44:26.685997 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:44:26.686059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:44:26.686117 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:44:26.994139 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:44:54.399883 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:44:54.400001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:44:54.400064 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:44:54.400134 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:44:54.400197 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:44:54.400257 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:44:54.400316 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:44:54.707775 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:44:57.256117 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:44:57.256202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:44:57.256275 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:44:57.256342 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:44:57.256399 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:44:57.256462 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:44:57.256520 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:44:57.559651 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:45:18.811106 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:45:18.811212 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:45:18.811292 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:45:18.811380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:45:18.811454 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:45:18.811544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:45:18.811626 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:45:19.114969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:45:24.976027 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:45:24.976145 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:45:24.976217 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:45:24.976293 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:45:24.976362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:45:24.976430 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:45:24.976506 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:45:25.292863 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:45:27.827579 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:45:27.827671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:45:27.827748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:45:27.827814 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:45:27.827873 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:45:27.827943 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:45:27.828010 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:45:28.129224 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:45:55.553041 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:45:55.553144 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:45:55.553206 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:45:55.553268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:45:55.553332 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:45:55.553392 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:45:55.553456 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:45:55.860612 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:45:58.389451 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:45:58.389552 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:45:58.389620 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:45:58.389688 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:45:58.389779 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:45:58.389848 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:45:58.389918 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:45:58.692947 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:46:18.934032 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:46:18.934111 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:46:18.934190 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:46:18.934249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:46:18.934317 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:46:18.934379 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:46:18.934440 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:46:19.240036 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:46:26.124136 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:46:26.124217 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:46:26.124280 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:46:26.124351 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:46:26.124409 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:46:26.124466 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:46:26.124530 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:46:26.433957 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:46:28.961501 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:46:28.961587 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:46:28.961668 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:46:28.961734 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:46:28.961805 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:46:28.961870 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:46:28.961938 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:46:29.270817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:46:56.688706 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:46:56.688819 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:46:56.688884 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:46:56.688946 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:46:56.689008 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:46:56.689066 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:46:56.689126 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:46:56.992390 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:46:59.535828 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:46:59.536377 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:46:59.536474 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:46:59.536574 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:46:59.536645 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:46:59.536712 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:46:59.536794 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:46:59.850160 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:47:19.058947 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:47:19.059032 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:47:19.059098 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:47:19.059168 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:47:19.059233 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:47:19.059296 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:47:19.059363 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:47:19.370255 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:47:27.253732 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:47:27.253821 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:47:27.253895 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:47:27.253960 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:47:27.254023 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:47:27.254083 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:47:27.254145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:47:27.561189 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:47:30.113730 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:47:30.113834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:47:30.113899 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:47:30.113969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:47:30.114032 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:47:30.114100 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:47:30.114166 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:47:30.421938 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:47:57.819757 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:47:57.819840 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:47:57.819913 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:47:57.819975 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:47:57.820044 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:47:57.820102 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:47:57.820164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:47:58.125197 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:48:00.683943 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:48:00.684033 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:48:00.684107 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:48:00.684175 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:48:00.684236 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:48:00.684302 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:48:00.684372 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:48:00.993125 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:48:19.181319 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:48:19.181395 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:48:19.181471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:48:19.181539 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:48:19.181602 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:48:19.181666 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:48:19.181738 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:48:19.494323 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:48:28.389337 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:48:28.389423 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:48:28.389499 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:48:28.389569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:48:28.389637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:48:28.389713 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:48:28.389781 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:48:28.695853 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:48:31.247848 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:48:31.247937 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:48:31.248003 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:48:31.248064 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:48:31.248127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:48:31.248185 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:48:31.248247 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:48:31.552644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:48:58.974386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:48:58.974469 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:48:58.974536 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:48:58.974595 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:48:58.974660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:48:58.974726 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:48:58.974792 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:48:59.283436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:49:01.836209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:49:01.836299 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:49:01.836366 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:49:01.836430 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:49:01.836498 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:49:01.836560 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:49:01.836624 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:49:02.149671 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:49:19.306261 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:49:19.306351 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:49:19.306428 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:49:19.307290 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:49:19.307676 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:49:19.307880 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:49:19.308079 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:49:19.621191 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:49:29.556316 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:49:29.556409 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:49:29.556478 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:49:29.556549 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:49:29.556614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:49:29.556675 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:49:29.556750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:49:29.859142 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:49:32.412009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:49:32.412092 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:49:32.412162 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:49:32.412240 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:49:32.412309 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:49:32.412377 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:49:32.412441 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:49:32.716380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:50:00.124017 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:50:00.124110 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:50:00.124190 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:50:00.124256 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:50:00.124318 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:50:00.124385 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:50:00.124443 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:50:00.430965 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:50:02.981302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:50:02.981393 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:50:02.981462 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:50:02.981529 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:50:02.981591 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:50:02.981656 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:50:02.981728 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:50:03.295153 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:50:19.426069 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:50:19.426149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:50:19.426221 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:50:19.426290 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:50:19.426356 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:50:19.426424 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:50:19.426489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:50:19.730885 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:50:30.698836 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:50:30.698945 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:50:30.699013 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:50:30.699101 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:50:30.699184 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:50:30.699238 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:50:30.699321 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:50:31.012166 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:50:33.565042 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:50:33.565151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:50:33.565258 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:50:33.565332 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:50:33.565399 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:50:33.565473 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:50:33.565547 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:50:33.878696 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:51:01.276395 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:51:01.276507 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:51:01.276576 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:51:01.276646 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:51:01.276711 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:51:01.276778 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:51:01.276849 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:51:01.578908 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:51:04.139118 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:51:04.139209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:51:04.139273 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:51:04.139365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:51:04.139429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:51:04.139506 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:51:04.139572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:51:04.449258 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:51:19.544477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:51:19.544560 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:51:19.544629 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:51:19.544697 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:51:19.544766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:51:19.544834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:51:19.544895 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:51:19.860204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:51:31.854976 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:51:31.855057 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:51:31.855120 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:51:31.855195 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:51:31.855255 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:51:31.855316 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:51:31.855376 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:51:32.179729 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:51:34.708401 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:51:34.708488 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:51:34.708555 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:51:34.708619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:51:34.708688 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:51:34.708761 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:51:34.708841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:51:35.022153 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:52:02.442908 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:52:02.443026 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:52:02.443122 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:52:02.443216 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:52:02.443301 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:52:02.443394 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:52:02.443477 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:52:02.743162 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:52:05.291726 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:52:05.291827 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:52:05.291914 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:52:05.292005 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:52:05.292106 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:52:05.292183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:52:05.292262 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:52:05.594619 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:52:19.668836 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:52:19.668936 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:52:19.669020 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:52:19.669106 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:52:19.669189 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:52:19.669266 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:52:19.669334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:52:19.980495 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:52:33.002053 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:52:33.002162 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:52:33.002247 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:52:33.002324 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:52:33.002407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:52:33.002491 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:52:33.002571 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:52:33.308851 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:52:35.858714 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:52:35.858829 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:52:35.858906 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:52:35.858981 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:52:35.859065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:52:35.859155 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:52:35.859224 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:52:36.160836 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:53:03.566350 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:53:03.566459 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:53:03.566537 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:53:03.566611 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:53:03.566679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:53:03.566754 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:53:03.566825 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:53:03.872851 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:53:06.419037 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:53:06.419142 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:53:06.419221 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:53:06.419303 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:53:06.419380 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:53:06.419462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:53:06.419542 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:53:06.725210 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:53:19.799773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:53:19.799865 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:53:19.799950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:53:19.800026 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:53:19.800113 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:53:19.800205 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:53:19.800291 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:53:20.120266 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:53:34.135277 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:53:34.135389 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:53:34.135472 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:53:34.135560 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:53:34.135639 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:53:34.135721 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:53:34.135799 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:53:34.457899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:53:36.983790 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:53:36.983909 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:53:36.983994 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:53:36.984075 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:53:36.984154 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:53:36.984252 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:53:36.984325 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:53:37.285420 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:54:04.724330 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:54:04.724424 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:54:04.724489 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:54:04.724575 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:54:04.724652 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:54:04.724733 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:54:04.724804 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:54:05.036572 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:54:07.544448 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:54:07.544550 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:54:07.544640 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:54:07.544734 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:54:07.544839 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:54:07.544927 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:54:07.545003 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:54:07.847993 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:54:19.918534 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:54:19.918649 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:54:19.918737 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:54:19.918828 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:54:19.918911 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:54:19.918995 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:54:19.919078 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:54:20.235151 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:54:35.299970 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:54:35.300073 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:54:35.300150 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:54:35.300225 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:54:35.300296 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:54:35.300363 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:54:35.300441 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:54:35.602686 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:54:38.106429 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:54:38.106512 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:54:38.106583 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:54:38.106645 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:54:38.106711 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:54:38.106778 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:54:38.106837 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:54:38.412804 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:55:05.861174 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:55:05.861292 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:55:05.861348 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:55:05.861421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:55:05.861481 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:55:05.861542 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:55:05.861598 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:55:06.168477 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:55:08.679966 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:55:08.680079 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:55:08.680171 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:55:08.680249 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:55:08.680331 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:55:08.680435 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:55:08.680522 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:55:08.991062 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:55:20.041386 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:55:20.041485 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:55:20.041570 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:55:20.041647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:55:20.041738 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:55:20.041822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:55:20.041905 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:55:20.348897 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:55:36.431404 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:55:36.431514 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:55:36.431588 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:55:36.431658 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:55:36.431742 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:55:36.431811 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:55:36.431891 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:55:36.736733 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:55:39.252267 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:55:39.252361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:55:39.252429 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:55:39.252491 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:55:39.252571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:55:39.252637 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:55:39.252706 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:55:39.558650 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:56:06.997643 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:56:06.997735 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:56:06.997818 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:56:06.997889 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:56:06.997951 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:56:06.998017 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:56:06.998086 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:56:07.306103 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:56:09.826576 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:56:09.826693 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:56:09.826784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:56:09.826876 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:56:09.826950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:56:09.827030 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:56:09.827111 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:56:10.139158 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:56:20.166139 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:56:20.166237 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:56:20.166314 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:56:20.166396 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:56:20.166470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:56:20.166543 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:56:20.166617 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:56:20.474584 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:56:37.567997 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:56:37.568127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:56:37.568204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:56:37.568279 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:56:37.568348 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:56:37.568418 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:56:37.568479 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:56:37.883661 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:56:40.404621 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:56:40.404715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:56:40.404781 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:56:40.404848 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:56:40.404911 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:56:40.404976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:56:40.405036 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:56:40.716820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:57:08.147660 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:57:08.147757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:57:08.147818 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:57:08.147890 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:57:08.147953 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:57:08.148022 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:57:08.148088 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:57:08.448833 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:57:10.973638 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:57:10.973746 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:57:10.973821 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:57:10.973896 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:57:10.973958 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:57:10.974020 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:57:10.974081 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:57:11.285348 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:57:20.285589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:57:20.285687 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:57:20.285763 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:57:20.285833 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:57:20.285894 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:57:20.285964 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:57:20.286020 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:57:20.589191 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:57:38.713699 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:57:38.713790 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:57:38.713865 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:57:38.713937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:57:38.714006 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:57:38.714075 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:57:38.714142 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:57:39.020149 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:57:41.544526 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:57:41.544616 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:57:41.544685 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:57:41.544760 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:57:41.544825 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:57:41.544889 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:57:41.544951 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:57:41.864708 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:58:09.293931 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:58:09.294016 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:58:09.294095 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:58:09.294160 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:58:09.294226 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:58:09.294290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:58:09.294346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:58:09.598188 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:58:12.144652 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:58:12.144738 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:58:12.144808 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:58:12.144871 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:58:12.144936 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:58:12.144996 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:58:12.145060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:58:12.455216 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:58:20.408061 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:58:20.408142 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:58:20.408215 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:58:20.408281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:58:20.408346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:58:20.408407 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:58:20.408468 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:58:20.713178 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:58:39.862805 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:58:39.862892 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:58:39.862972 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:58:39.863033 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:58:39.863100 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:58:39.863167 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:58:39.863231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:58:40.188163 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:58:42.720823 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:58:42.720912 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:58:42.720992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:58:42.721064 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:58:42.721137 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:58:42.721223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:58:42.721311 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:58:43.026577 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:59:10.455949 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:59:10.456037 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:59:10.456114 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:59:10.456180 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:59:10.456254 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:59:10.456322 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:59:10.456382 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:59:10.765524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:59:13.303092 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:59:13.303178 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:59:13.303241 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:59:13.303308 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:59:13.303369 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:59:13.303434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:59:13.303495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:59:13.615337 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:59:20.536397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:59:20.536486 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:59:20.536555 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:59:20.536631 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:59:20.536696 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:59:20.536763 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:59:20.536825 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:59:20.848915 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:59:41.029738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:59:41.029825 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:59:41.029904 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:59:41.029969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:59:41.030032 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:59:41.030107 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:59:41.030170 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:59:41.339737 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 12:59:43.878297 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 12:59:43.878383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 12:59:43.878456 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 12:59:43.878522 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 12:59:43.878585 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 12:59:43.878649 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 12:59:43.878713 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 12:59:44.180271 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:00:11.608989 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:00:11.609086 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:00:11.609153 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:00:11.609215 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:00:11.609281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:00:11.609352 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:00:11.609417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:00:11.910832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:00:14.443843 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:00:14.443927 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:00:14.444003 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:00:14.444069 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:00:14.444134 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:00:14.444195 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:00:14.444259 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:00:14.758216 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:00:20.668594 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:00:20.668699 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:00:20.668798 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:00:20.668878 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:00:20.668954 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:00:20.669033 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:00:20.669113 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:00:20.985536 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:00:42.193937 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:00:42.194030 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:00:42.194109 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:00:42.194183 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:00:42.194256 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:00:42.194328 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:00:42.194404 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:00:42.496601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:00:45.022384 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:00:45.022483 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:00:45.022565 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:00:45.022639 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:00:45.022724 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:00:45.022794 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:00:45.022877 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:00:45.327832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:01:12.761156 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:01:12.761305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:01:12.761394 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:01:12.761479 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:01:12.761569 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:01:12.761676 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:01:12.761773 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:01:13.070826 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:01:15.588879 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:01:15.588976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:01:15.589059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:01:15.589148 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:01:15.589231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:01:15.589319 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:01:15.589394 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:01:15.890684 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:01:20.802746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:01:20.802852 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:01:20.802921 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:01:20.802986 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:01:20.803056 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:01:20.803129 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:01:20.803205 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:01:21.111607 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:01:43.330796 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:01:43.330886 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:01:43.330956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:01:43.331021 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:01:43.331084 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:01:43.331150 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:01:43.331214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:01:43.636142 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:01:46.150387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:01:46.150490 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:01:46.150567 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:01:46.150657 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:01:46.150750 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:01:46.150835 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:01:46.150912 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:01:46.457067 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:02:13.901486 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:02:13.901579 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:02:13.901661 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:02:13.901749 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:02:13.901825 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:02:13.901903 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:02:13.901993 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:02:14.234442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:02:16.726082 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:02:16.726199 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:02:16.726279 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:02:16.726391 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:02:16.726465 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:02:16.726532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:02:16.726619 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:02:17.026994 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:02:20.928875 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:02:20.928957 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:02:20.929025 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:02:20.929095 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:02:20.929159 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:02:20.929229 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:02:20.929294 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:02:21.237041 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:02:44.505584 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:02:44.505692 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:02:44.505765 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:02:44.505830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:02:44.505896 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:02:44.505961 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:02:44.506031 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:02:44.813993 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:02:47.291096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:02:47.291208 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:02:47.291286 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:02:47.291366 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:02:47.291442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:02:47.291529 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:02:47.291607 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:02:47.594158 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:03:15.081749 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:03:15.081860 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:03:15.081937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:03:15.082018 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:03:15.082100 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:03:15.082182 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:03:15.082260 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:03:15.384902 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:03:17.862509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:03:17.862632 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:03:17.862713 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:03:17.862800 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:03:17.862881 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:03:17.862969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:03:17.863047 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:03:18.168837 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:03:21.060639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:03:21.060731 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:03:21.060813 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:03:21.060902 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:03:21.060970 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:03:21.061044 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:03:21.061121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:03:21.371749 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:03:45.642758 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:03:45.642859 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:03:45.642956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:03:45.643038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:03:45.643118 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:03:45.643198 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:03:45.643280 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:03:45.947065 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:03:48.427883 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:03:48.427982 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:03:48.428069 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:03:48.428146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:03:48.428224 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:03:48.428289 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:03:48.428371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:03:48.729030 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:04:16.209675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:04:16.209795 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:04:16.209881 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:04:16.209965 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:04:16.210037 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:04:16.210113 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:04:16.210187 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:04:16.514911 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:04:19.001367 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:04:19.001457 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:04:19.001533 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:04:19.001614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:04:19.001690 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:04:19.001771 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:04:19.001842 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:04:19.310681 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:04:21.189949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:04:21.190036 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:04:21.190118 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:04:21.190188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:04:21.190254 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:04:21.190323 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:04:21.190389 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:04:21.490880 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:04:46.775446 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:04:46.775563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:04:46.775627 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:04:46.775705 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:04:46.775778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:04:46.775854 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:04:46.775926 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:04:47.086970 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:04:49.571087 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:04:49.571189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:04:49.571259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:04:49.571325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:04:49.571396 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:04:49.571458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:04:49.571521 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:04:49.889254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:05:17.351278 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:05:17.351372 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:05:17.351439 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:05:17.351503 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:05:17.351568 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:05:17.351629 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:05:17.351690 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:05:17.656415 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:05:20.155533 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:05:20.155623 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:05:20.155695 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:05:20.155770 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:05:20.155837 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:05:20.155901 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:05:20.155967 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:05:20.459850 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:05:21.318704 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:05:21.318788 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:05:21.318862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:05:21.318928 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:05:21.318990 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:05:21.319048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:05:21.319123 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:05:21.635473 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:05:47.934847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:05:47.934955 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:05:47.935024 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:05:47.935095 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:05:47.935156 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:05:47.935219 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:05:47.935289 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:05:48.242749 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:05:50.716385 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:05:50.716466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:05:50.716534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:05:50.716599 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:05:50.716666 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:05:50.716731 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:05:50.716791 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:05:51.023875 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:06:18.505989 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:06:18.506103 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:06:18.506180 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:06:18.506248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:06:18.506316 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:06:18.506390 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:06:18.506451 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:06:18.813624 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:06:21.286068 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:06:21.286160 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:06:21.286237 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:06:21.286305 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:06:21.286362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:06:21.286425 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:06:21.286482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:06:21.599751 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:06:21.876986 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:06:21.877075 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:06:21.877144 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:06:21.877221 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:06:21.877286 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:06:21.877356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:06:21.877429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:06:22.207174 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:06:49.077485 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:06:49.077570 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:06:49.077648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:06:49.077710 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:06:49.077778 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:06:49.077843 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:06:49.077906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:06:49.393442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:06:51.878551 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:06:51.878634 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:06:51.878714 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:06:51.878801 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:06:51.878869 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:06:51.878945 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:06:51.879011 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:06:52.205120 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:07:19.656798 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:07:19.656901 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:07:19.656964 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:07:19.657037 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:07:19.657102 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:07:19.657170 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:07:19.657231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:07:19.966468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:07:21.573763 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:07:21.573864 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:07:21.573955 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:07:21.574051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:07:21.574132 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:07:21.574209 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:07:21.574288 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:07:21.875898 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:07:22.468692 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:07:22.468812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:07:22.468891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:07:22.468980 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:07:22.469065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:07:22.469141 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:07:22.469215 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:07:22.769746 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:07:50.254881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:07:50.255013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:07:50.255110 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:07:50.255213 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:07:50.255320 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:07:50.255415 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:07:50.255507 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:07:50.559449 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:07:53.030489 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:07:53.030588 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:07:53.030668 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:07:53.030770 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:07:53.031738 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:07:53.032227 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:07:53.032430 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:07:53.336320 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:08:20.825735 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:08:20.825819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:08:20.825889 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:08:20.825962 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:08:20.826035 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:08:20.826106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:08:20.826179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:08:21.133899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:08:21.706907 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:08:21.707003 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:08:21.707093 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:08:21.707180 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:08:21.707279 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:08:21.707364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:08:21.707450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:08:22.018521 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:08:23.599690 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:08:23.599795 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:08:23.599907 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:08:23.600001 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:08:23.600095 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:08:23.600176 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:08:23.600268 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:08:23.897125 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:08:51.395984 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:08:51.396075 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:08:51.396166 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:08:51.396236 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:08:51.396320 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:08:51.396391 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:08:51.396468 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:08:51.707204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:08:54.162969 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:08:54.163098 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:08:54.163176 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:08:54.163242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:08:54.163309 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:08:54.163379 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:08:54.163442 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:08:54.470596 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:09:21.835353 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:09:21.835456 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:09:21.835546 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:09:21.835626 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:09:21.835701 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:09:21.835788 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:09:21.835869 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:09:22.162104 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:09:22.426015 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:09:22.426123 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:09:22.426201 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:09:22.426272 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:09:22.426342 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:09:22.426415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:09:22.426497 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:09:22.729114 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:09:24.729869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:09:24.729952 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:09:24.730023 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:09:24.730095 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:09:24.730156 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:09:24.730224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:09:24.730287 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:09:25.040065 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:09:52.426948 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:09:52.427043 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:09:52.427104 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:09:52.427173 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:09:52.427231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:09:52.427299 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:09:52.427361 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:09:52.730626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:09:55.308662 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:09:55.308780 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:09:55.308844 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:09:55.308908 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:09:55.308977 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:09:55.309045 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:09:55.309108 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:09:55.612147 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:10:21.963598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:10:21.964383 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:10:21.964491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:10:21.964590 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:10:21.964674 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:10:21.964755 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:10:21.964824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:10:22.268975 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:10:22.989086 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:10:22.989207 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:10:22.989295 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:10:22.989380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:10:22.989461 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:10:22.989549 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:10:22.989626 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:10:23.295490 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:10:25.874020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:10:25.874115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:10:25.874187 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:10:25.874256 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:10:25.874325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:10:25.874402 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:10:25.874473 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:10:26.177410 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:10:53.552435 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:10:53.552548 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:10:53.552621 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:10:53.552681 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:10:53.552743 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:10:53.552814 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:10:53.552881 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:10:53.868140 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:10:56.438128 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:10:56.438210 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:10:56.438279 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:10:56.438334 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:10:56.438399 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:10:56.438455 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:10:56.438519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:10:56.738968 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:11:22.087013 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:11:22.087121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:11:22.087225 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:11:22.087313 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:11:22.087399 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:11:22.087483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:11:22.087590 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:11:22.408322 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:11:24.134477 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:11:24.134575 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:11:24.134658 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:11:24.134765 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:11:24.134858 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:11:24.134932 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:11:24.135027 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:11:24.459921 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:11:26.997618 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:11:26.997752 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:11:26.997825 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:11:26.997898 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:11:26.997966 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:11:26.998035 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:11:26.998107 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:11:27.306468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:11:54.721196 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:11:54.721283 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:11:54.721364 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:11:54.721427 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:11:54.721494 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:11:54.721552 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:11:54.721619 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:11:55.030666 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:11:57.567036 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:11:57.567139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:11:57.567216 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:11:57.567279 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:11:57.567339 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:11:57.567397 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:11:57.567463 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:11:57.878440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:12:22.213310 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:12:22.213408 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:12:22.213470 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:12:22.213533 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:12:22.213597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:12:22.213665 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:12:22.213734 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:12:22.526811 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:12:25.299359 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:12:25.299460 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:12:25.299543 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:12:25.299627 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:12:25.299711 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:12:25.299794 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:12:25.299874 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:12:25.602603 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:12:28.139242 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:12:28.139342 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:12:28.139429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:12:28.139507 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:12:28.139583 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:12:28.139655 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:12:28.139733 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:12:28.447140 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:12:55.857796 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:12:55.857910 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:12:55.857983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:12:55.858051 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:12:55.858121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:12:55.858183 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:12:55.858247 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:12:56.162967 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:12:58.707071 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:12:58.707155 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:12:58.707222 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:12:58.707295 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:12:58.707364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:12:58.707429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:12:58.707494 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:12:59.019435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:13:22.341453 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:13:22.341534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:13:22.341597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:13:22.341662 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:13:22.341729 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:13:22.341803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:13:22.341861 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:13:22.645165 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:13:26.421399 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:13:26.421517 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:13:26.421597 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:13:26.421658 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:13:26.421726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:13:26.421797 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:13:26.421857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:13:26.728303 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:13:29.281799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:13:29.281902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:13:29.281978 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:13:29.282053 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:13:29.282144 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:13:29.282223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:13:29.283377 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:13:29.593621 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:13:56.989943 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:13:56.990025 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:13:56.990105 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:13:56.990172 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:13:56.990243 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:13:56.990314 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:13:56.990379 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:13:57.303807 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:13:59.851434 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:13:59.851511 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:13:59.851583 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:13:59.851654 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:13:59.851725 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:13:59.851787 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:13:59.851859 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:14:00.162862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:14:22.469873 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:14:22.469960 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:14:22.470025 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:14:22.470089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:14:22.470150 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:14:22.470217 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:14:22.470283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:14:22.783090 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:14:27.564728 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:14:27.564817 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:14:27.564880 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:14:27.564941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:14:27.565003 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:14:27.565060 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:14:27.565124 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:14:27.868500 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:14:30.425484 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:14:30.425578 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:14:30.425645 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:14:30.425713 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:14:30.425785 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:14:30.425853 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:14:30.425918 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:14:30.728147 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:14:58.125995 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:14:58.127233 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:14:58.127676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:14:58.128548 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:14:58.129327 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:14:58.129415 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:14:58.129483 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:14:58.436965 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:15:00.990928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:15:00.991024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:15:00.991114 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:15:00.991209 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:15:00.991287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:15:00.991364 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:15:00.991448 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:15:01.296320 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:15:22.597927 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:15:22.598036 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:15:22.598112 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:15:22.598179 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:15:22.598258 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:15:22.598334 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:15:22.598416 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:15:22.905761 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:15:28.699279 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:15:28.699368 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:15:28.699437 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:15:28.699502 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:15:28.699563 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:15:28.699638 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:15:28.699702 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:15:29.016400 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:15:31.555736 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:15:31.555846 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:15:31.555925 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:15:31.555994 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:15:31.556062 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:15:31.556118 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:15:31.556187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:15:31.869238 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:15:59.288558 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:15:59.288654 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:15:59.288734 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:15:59.288796 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:15:59.288859 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:15:59.288919 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:15:59.288992 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:15:59.597850 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:16:02.139610 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:16:02.139690 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:16:02.139772 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:16:02.139844 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:16:02.139910 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:16:02.139976 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:16:02.140046 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:16:02.446243 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:16:22.726557 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:16:22.726655 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:16:22.726739 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:16:22.726815 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:16:22.726891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:16:22.726963 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:16:22.727030 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:16:23.044707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:16:29.853553 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:16:29.853680 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:16:29.853769 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:16:29.853850 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:16:29.853920 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:16:29.854008 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:16:29.854079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:16:30.173120 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:16:32.707527 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:16:32.707640 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:16:32.707714 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:16:32.707793 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:16:32.707875 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:16:32.707956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:16:32.708025 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:16:33.014830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:17:00.438699 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:17:00.438788 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:17:00.438859 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:17:00.438926 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:17:00.438990 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:17:00.439059 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:17:00.439138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:17:00.742103 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:17:03.278826 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:17:03.278915 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:17:03.278979 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:17:03.279045 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:17:03.279110 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:17:03.279174 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:17:03.279240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:17:03.586063 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:17:22.854678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:17:22.854798 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:17:22.854880 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:17:22.854970 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:17:22.855051 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:17:22.855130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:17:22.855212 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:17:23.154955 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:17:31.003814 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:17:31.003923 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:17:31.003998 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:17:31.004073 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:17:31.004151 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:17:31.004215 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:17:31.004288 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:17:31.312330 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:17:33.841933 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:17:33.842011 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:17:33.842097 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:17:33.842161 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:17:33.842229 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:17:33.842290 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:17:33.842353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:17:34.149908 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:18:01.579300 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:18:01.579404 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:18:01.579492 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:18:01.579556 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:18:01.579628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:18:01.579690 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:18:01.579763 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:18:01.886016 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:18:04.407738 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:18:04.407820 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:18:04.407889 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:18:04.407951 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:18:04.408023 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:18:04.408093 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:18:04.408165 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:18:04.715652 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:18:22.988682 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:18:22.988799 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:18:22.988877 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:18:22.988959 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:18:22.989036 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:18:22.989113 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:18:22.989187 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:18:23.300605 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:18:32.151784 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:18:32.151872 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:18:32.151940 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:18:32.152011 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:18:32.152077 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:18:32.152150 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:18:32.152215 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:18:32.461820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:18:34.993186 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:18:34.993270 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:18:34.993339 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:18:34.993403 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:18:34.993470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:18:34.993540 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:18:34.993607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:18:35.299578 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:19:02.723097 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:19:02.723190 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:19:02.723263 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:19:02.723327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:19:02.723389 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:19:02.723445 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:19:02.723507 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:19:03.039993 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:19:05.561554 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:19:05.561657 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:19:05.561765 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:19:05.561842 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:19:05.561918 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:19:05.561986 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:19:05.562067 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:19:05.868335 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:19:23.118833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:19:23.120656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:19:23.121399 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:19:23.121857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:19:23.122571 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:19:23.122684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:19:23.122769 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:19:23.435386 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:19:33.302507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:19:33.302596 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:19:33.302665 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:19:33.302742 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:19:33.302810 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:19:33.302878 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:19:33.302943 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:19:33.607974 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:19:36.130177 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:19:36.130268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:19:36.130335 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:19:36.130401 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:19:36.130463 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:19:36.130533 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:19:36.130594 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:19:36.435142 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:20:03.875021 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:20:03.875103 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:20:03.875178 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:20:03.875243 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:20:03.875310 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:20:03.875372 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:20:03.875436 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:20:04.181216 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:20:06.697312 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:20:06.697412 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:20:06.697477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:20:06.697539 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:20:06.697603 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:20:06.697670 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:20:06.697736 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:20:07.012089 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:20:23.244270 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:20:23.244358 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:20:23.244427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:20:23.244489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:20:23.244559 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:20:23.244623 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:20:23.244689 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:20:23.551918 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:20:34.443023 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:20:34.443801 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:20:34.444316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:20:34.444413 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:20:34.444485 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:20:34.444555 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:20:34.444620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:20:34.758443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:20:37.273712 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:20:37.273810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:20:37.273883 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:20:37.273945 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:20:37.274020 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:20:37.274081 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:20:37.274145 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:20:37.574468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:21:05.026104 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:21:05.026188 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:21:05.026255 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:21:05.026318 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:21:05.026391 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:21:05.026448 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:21:05.026515 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:21:05.335217 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:21:07.842626 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:21:07.842707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:21:07.842783 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:21:07.842848 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:21:07.842910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:21:07.842971 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:21:07.843037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:21:08.144035 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:21:23.370251 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:21:23.370330 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:21:23.370406 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:21:23.370467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:21:23.370532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:21:23.370599 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:21:23.370663 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:21:23.678541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:21:35.601654 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:21:35.601750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:21:35.601830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:21:35.601892 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:21:35.601972 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:21:35.602035 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:21:35.602101 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:21:35.902243 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:21:38.401573 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:21:38.401682 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:21:38.401760 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:21:38.401826 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:21:38.401884 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:21:38.401945 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:21:38.402022 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:21:38.705160 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:22:06.163479 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:22:06.163576 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:22:06.163642 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:22:06.163713 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:22:06.163785 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:22:06.163852 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:22:06.163916 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:22:06.473065 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:22:08.968751 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:22:08.968837 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:22:08.968912 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:22:08.968973 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:22:08.969039 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:22:08.969099 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:22:08.969162 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:22:09.274850 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:22:23.495959 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:22:23.496038 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:22:23.496109 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:22:23.496167 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:22:23.496235 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:22:23.496299 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:22:23.496367 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:22:23.800542 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:22:36.733259 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:22:36.733365 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:22:36.733427 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:22:36.733492 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:22:36.733550 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:22:36.733615 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:22:36.733673 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:22:37.048370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:22:39.543479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:22:39.543566 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:22:39.543638 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:22:39.543701 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:22:39.543765 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:22:39.543834 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:22:39.543902 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:22:39.850359 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:23:07.311387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:23:07.311515 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:23:07.311617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:23:07.311698 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:23:07.311821 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:23:07.311917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:23:07.312010 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:23:07.614925 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:23:10.111223 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:23:10.111324 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:23:10.111405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:23:10.111491 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:23:10.111570 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:23:10.111650 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:23:10.111736 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:23:10.414221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:23:23.621286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:23:23.621378 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:23:23.621451 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:23:23.621527 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:23:23.621593 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:23:23.621671 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:23:23.621748 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:23:23.929998 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:23:37.877295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:23:37.877385 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:23:37.877463 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:23:37.877535 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:23:37.877605 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:23:37.877674 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:23:37.877748 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:23:38.178978 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:23:40.674129 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:23:40.674249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:23:40.674335 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:23:40.674422 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:23:40.674493 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:23:40.674569 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:23:40.674642 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:23:40.986758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:24:08.434093 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:24:08.434207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:24:08.434287 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:24:08.434389 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:24:08.434472 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:24:08.434568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:24:08.434649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:24:08.745787 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:24:11.246032 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:24:11.246134 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:24:11.246207 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:24:11.246278 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:24:11.246345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:24:11.246411 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:24:11.246482 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:24:11.549755 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:24:23.746419 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:24:23.746501 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:24:23.746563 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:24:23.746632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:24:23.746698 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:24:23.746766 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:24:23.746828 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:24:24.060608 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:24:39.014315 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:24:39.014399 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:24:39.014484 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:24:39.014548 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:24:39.014617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:24:39.014685 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:24:39.014750 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:24:39.321651 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:24:41.825591 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:24:41.825686 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:24:41.825774 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:24:41.825843 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:24:41.825935 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:24:41.825997 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:24:41.826067 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:24:42.141818 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:25:09.580412 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:25:09.580510 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:25:09.580578 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:25:09.580644 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:25:09.580709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:25:09.580778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:25:09.580850 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:25:09.899635 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:25:12.401858 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:25:12.401943 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:25:12.402027 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:25:12.402089 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:25:12.402151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:25:12.402219 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:25:12.402285 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:25:12.709744 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:25:23.875175 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:25:23.875270 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:25:23.875339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:25:23.875409 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:25:23.875472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:25:23.875538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:25:23.875601 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:25:24.191900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:25:40.165398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:25:40.165496 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:25:40.165558 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:25:40.165628 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:25:40.165689 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:25:40.165762 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:25:40.165826 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:25:40.467857 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:25:42.970067 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:25:42.970172 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:25:42.970244 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:25:42.970321 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:25:42.970381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:25:42.970446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:25:42.970513 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:25:43.270129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:26:10.734103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:26:10.734191 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:26:10.734258 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:26:10.734328 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:26:10.734404 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:26:10.734480 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:26:10.734545 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:26:11.040904 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:26:13.530046 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:26:13.530147 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:26:13.530220 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:26:13.530283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:26:13.530348 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:26:13.530411 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:26:13.530477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:26:13.841861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:26:23.999113 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:26:23.999346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:26:23.999465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:26:23.999541 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:26:23.999618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:26:23.999687 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:26:23.999767 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:26:24.308218 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:26:41.301549 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:26:41.301643 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:26:41.301709 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:26:41.301774 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:26:41.301840 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:26:41.301902 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:26:41.301965 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:26:41.607790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:26:44.105683 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:26:44.105773 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:26:44.105845 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:26:44.105906 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:26:44.105984 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:26:44.106058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:26:44.106122 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:26:44.411868 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:27:11.870863 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:27:11.870950 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:27:11.871025 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:27:11.871104 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:27:11.871182 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:27:11.871252 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:27:11.871318 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:27:12.181207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:27:14.671738 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:27:14.671832 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:27:14.671897 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:27:14.671972 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:27:14.672038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:27:14.672103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:27:14.672164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:27:14.977129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:27:24.130143 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:27:24.130250 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:27:24.130335 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:27:24.130414 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:27:24.130506 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:27:24.130608 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:27:24.130673 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:27:24.447211 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:27:42.453407 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:27:42.453506 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:27:42.453577 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:27:42.453640 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:27:42.453705 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:27:42.453772 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:27:42.453848 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:27:42.761980 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:27:45.235060 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:27:45.235142 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:27:45.235210 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:27:45.235272 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:27:45.235345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:27:45.235406 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:27:45.235470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:27:45.543237 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:28:13.027726 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:28:13.027813 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:28:13.027877 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:28:13.027956 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:28:13.028018 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:28:13.028080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:28:13.028140 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:28:13.335856 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:28:15.805195 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:28:15.805281 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:28:15.805350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:28:15.805415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:28:15.805482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:28:15.805547 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:28:15.805610 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:28:16.117841 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:28:24.256160 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:28:24.256245 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:28:24.256309 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:28:24.256384 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:28:24.256451 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:28:24.256513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:28:24.256575 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:28:24.564061 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:28:43.601508 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:28:43.601619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:28:43.601700 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:28:43.601795 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:28:43.601868 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:28:43.601957 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:28:43.602028 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:28:43.916015 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:28:46.379240 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:28:46.379334 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:28:46.379406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:28:46.379480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:28:46.379543 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:28:46.379614 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:28:46.379688 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:28:46.687261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:29:14.180934 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:29:14.181020 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:29:14.181087 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:29:14.181152 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:29:14.181214 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:29:14.181294 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:29:14.181356 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:29:14.500026 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:29:16.948474 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:29:16.948595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:29:16.948675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:29:16.948781 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:29:16.948859 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:29:16.948927 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:29:16.949013 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:29:17.248436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:29:24.377116 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:29:24.377219 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:29:24.377311 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:29:24.377391 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:29:24.377468 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:29:24.377551 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:29:24.377631 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:29:24.678397 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:29:44.770224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:29:44.770349 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:29:44.770425 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:29:44.770502 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:29:44.770581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:29:44.770664 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:29:44.770765 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:29:45.083093 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:29:47.505962 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:29:47.506080 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:29:47.506154 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:29:47.506239 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:29:47.506321 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:29:47.506406 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:29:47.506482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:29:47.825856 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:30:15.348398 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:30:15.348500 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:30:15.348577 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:30:15.348659 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:30:15.348749 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:30:15.348839 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:30:15.348918 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:30:15.652873 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:30:18.087041 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:30:18.087153 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:30:18.087231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:30:18.087313 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:30:18.087391 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:30:18.087479 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:30:18.087558 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:30:18.390365 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:30:24.500782 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:30:24.500883 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:30:24.500964 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:30:24.501054 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:30:24.501128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:30:24.501222 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:30:24.501305 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:30:24.808755 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:30:45.909141 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:30:45.909261 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:30:45.909349 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:30:45.909424 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:30:45.909518 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:30:45.909594 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:30:45.909678 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:30:46.214391 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:30:48.649825 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:30:48.650410 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:30:48.650986 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:30:48.651072 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:30:48.651152 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:30:48.651229 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:30:48.651304 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:30:48.953011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:31:16.475462 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:31:16.475553 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:31:16.475640 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:31:16.475715 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:31:16.475809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:31:16.475887 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:31:16.475975 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:31:16.785517 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:31:19.218888 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:31:19.218985 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:31:19.219068 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:31:19.219158 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:31:19.219238 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:31:19.219325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:31:19.219400 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:31:19.520862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:31:24.624714 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:31:24.624814 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:31:24.624890 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:31:24.624964 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:31:24.625053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:31:24.625125 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:31:24.625202 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:31:24.929083 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:31:47.051339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:31:47.051444 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:31:47.051524 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:31:47.051595 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:31:47.051665 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:31:47.051745 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:31:47.051815 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:31:47.353913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:31:49.784215 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:31:49.784344 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:31:49.784431 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:31:49.784506 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:31:49.784583 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:31:49.784657 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:31:49.784753 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:31:50.098774 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:32:17.610850 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:32:17.612123 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:32:17.612608 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:32:17.613366 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:32:17.613664 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:32:17.614368 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:32:17.614467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:32:17.937420 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:32:20.361794 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:32:20.361902 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:32:20.361988 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:32:20.362061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:32:20.362140 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:32:20.362216 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:32:20.362295 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:32:20.673057 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:32:24.748520 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:32:24.748632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:32:24.748729 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:32:24.748817 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:32:24.748890 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:32:24.748975 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:32:24.749066 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:32:25.064427 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:32:48.192423 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:32:48.192515 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:32:48.192589 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:32:48.192658 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:32:48.192733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:32:48.192797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:32:48.192865 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:32:48.497461 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:32:50.949261 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:32:50.949350 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:32:50.949429 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:32:50.949498 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:32:50.949563 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:32:50.949631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:32:50.949693 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:32:51.254917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:33:18.759325 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:33:18.759417 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:33:18.759485 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:33:18.759549 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:33:18.759619 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:33:18.759681 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:33:18.759758 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:33:19.066636 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:33:21.517314 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:33:21.518000 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:33:21.518441 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:33:21.519445 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:33:21.519571 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:33:21.519661 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:33:21.519742 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:33:21.822306 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:33:24.871460 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:33:24.871570 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:33:24.871654 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:33:24.871750 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:33:24.871829 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:33:24.871906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:33:24.871975 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:33:25.190913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:33:49.332282 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:33:49.332408 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:33:49.332475 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:33:49.332535 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:33:49.332599 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:33:49.332677 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:33:49.332753 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:33:49.641121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:33:52.093637 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:33:52.093725 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:33:52.093792 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:33:52.093857 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:33:52.093922 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:33:52.093985 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:33:52.094051 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:33:52.398749 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:34:19.917585 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:34:19.917671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:34:19.917752 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:34:19.917821 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:34:19.917896 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:34:19.917971 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:34:19.918048 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:34:20.239342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:34:22.660051 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:34:22.660135 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:34:22.660198 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:34:22.660259 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:34:22.660323 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:34:22.660391 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:34:22.660454 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:34:22.972232 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:34:24.993794 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:34:24.993894 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:34:24.993978 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:34:24.994059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:34:24.994133 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:34:24.994214 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:34:24.994292 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:34:25.301003 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:34:50.502275 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:34:50.502400 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:34:50.502482 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:34:50.502564 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:34:50.502648 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:34:50.502737 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:34:50.502824 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:34:50.802803 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:34:53.232790 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:34:53.232891 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:34:53.232973 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:34:53.233063 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:34:53.233136 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:34:53.233229 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:34:53.233301 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:34:53.544602 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:35:21.065375 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:35:21.065495 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:35:21.065562 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:35:21.065634 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:35:21.065702 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:35:21.065776 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:35:21.065843 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:35:21.371565 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:35:23.811360 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:35:23.811438 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:35:23.811513 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:35:23.811579 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:35:23.811637 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:35:23.811705 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:35:23.811772 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:35:24.118173 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:35:25.117770 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:35:25.117870 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:35:25.117993 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:35:25.118091 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:35:25.118167 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:35:25.118242 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:35:25.118358 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:35:25.428747 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:35:51.632091 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:35:51.632214 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:35:51.632296 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:35:51.632390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:35:51.632474 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:35:51.632556 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:35:51.632630 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:35:51.942819 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:35:54.383837 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:35:54.383930 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:35:54.384010 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:35:54.384080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:35:54.384157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:35:54.384222 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:35:54.384293 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:35:54.694796 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:36:22.207747 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:36:22.207850 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:36:22.207935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:36:22.208014 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:36:22.208109 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:36:22.208184 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:36:22.208270 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:36:22.517149 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:36:24.963232 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:36:24.963328 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:36:24.963404 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:36:24.963475 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:36:24.963545 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:36:24.963615 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:36:24.963692 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:36:25.281735 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:36:25.539403 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:36:25.539486 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:36:25.539558 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:36:25.539624 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:36:25.539687 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:36:25.539758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:36:25.539828 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:36:25.849019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:36:52.787404 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:36:52.787492 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:36:52.787568 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:36:52.787643 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:36:52.787714 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:36:52.787793 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:36:52.787861 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:36:53.115060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:36:55.540315 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:36:55.540401 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:36:55.540471 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:36:55.540538 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:36:55.540600 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:36:55.540670 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:36:55.540738 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:36:55.852556 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:37:23.374295 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:37:23.374371 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:37:23.374439 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:37:23.374502 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:37:23.374574 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:37:23.374645 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:37:23.374704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:37:23.682011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:37:25.359378 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:37:25.359481 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:37:25.359548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:37:25.359613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:37:25.359682 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:37:25.359768 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:37:25.359844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:37:25.669569 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:37:26.111235 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:37:26.111325 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:37:26.111402 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:37:26.111475 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:37:26.111543 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:37:26.111620 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:37:26.111682 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:37:26.413458 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:37:53.952101 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:37:53.952565 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:37:53.952823 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:37:53.953015 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:37:53.953854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:37:53.953989 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:37:53.954094 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:37:54.273170 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:37:56.675435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:37:56.675555 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:37:56.675641 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:37:56.675724 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:37:56.675808 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:37:56.675894 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:37:56.675967 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:37:56.983054 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:38:24.530841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:38:24.530949 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:38:24.531016 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:38:24.531090 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:38:24.531169 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:38:24.531238 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:38:24.531311 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:38:24.838297 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:38:25.485320 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:38:25.485415 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:38:25.485480 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:38:25.485550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:38:25.485610 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:38:25.485679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:38:25.485752 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:38:25.796362 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:38:27.244216 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:38:27.244299 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:38:27.244361 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:38:27.244429 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:38:27.244492 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:38:27.244567 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:38:27.244626 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:38:27.547274 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:38:55.110840 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:38:55.110925 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:38:55.110999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:38:55.111061 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:38:55.111128 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:38:55.111191 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:38:55.111255 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:38:55.420119 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:38:57.810387 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:38:57.810492 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:38:57.810597 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:38:57.810677 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:38:57.810760 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:38:57.810827 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:38:57.810921 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:38:58.111906 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:39:25.607277 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:39:25.607425 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:39:25.607503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:39:25.607593 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:39:25.607674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:39:25.607769 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:39:25.607847 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:39:25.910194 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:39:26.174533 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:39:26.174624 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:39:26.174703 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:39:26.174781 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:39:26.174856 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:39:26.174928 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:39:26.175002 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:39:26.479342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:39:28.375683 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:39:28.375805 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:39:28.375870 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:39:28.375925 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:39:28.375990 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:39:28.376052 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:39:28.376119 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:39:28.687379 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:39:56.176123 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:39:56.176215 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:39:56.176303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:39:56.176367 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:39:56.176445 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:39:56.176508 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:39:56.176572 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:39:56.490969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:39:58.950827 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:39:58.950914 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:39:58.950994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:39:58.951065 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:39:58.951130 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:39:58.951198 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:39:58.951257 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:39:59.259817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:40:25.729253 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:40:25.729374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:40:25.729510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:40:25.729621 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:40:25.729740 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:40:25.729857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:40:25.729976 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:40:26.048489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:40:26.752605 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:40:26.752703 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:40:26.752799 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:40:26.752887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:40:26.752970 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:40:26.753055 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:40:26.753129 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:40:27.062791 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:40:29.516934 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:40:29.517057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:40:29.517125 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:40:29.517199 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:40:29.517277 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:40:29.517348 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:40:29.517420 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:40:29.828004 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:40:57.322576 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:40:57.322671 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:40:57.322740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:40:57.322821 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:40:57.322884 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:40:57.322963 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:40:57.323028 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:40:57.632127 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:41:00.097814 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:41:00.097928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:41:00.098007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:41:00.098097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:41:00.098177 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:41:00.098251 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:41:00.098334 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:41:00.401884 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:41:25.845905 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:41:25.846003 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:41:25.846077 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:41:25.846158 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:41:25.846230 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:41:25.846306 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:41:25.847501 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:41:26.157691 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:41:27.888477 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:41:27.888564 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:41:27.888632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:41:27.888704 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:41:27.888776 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:41:27.888842 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:41:27.888914 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:41:28.194477 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:41:30.665703 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:41:30.665831 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:41:30.665914 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:41:30.665993 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:41:30.666073 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:41:30.666151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:41:30.666238 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:41:30.978037 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:41:58.450618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:41:58.450742 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:41:58.450820 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:41:58.450905 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:41:58.450973 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:41:58.451051 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:41:58.451133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:41:58.752653 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:42:01.238060 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:42:01.238178 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:42:01.238259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:42:01.238336 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:42:01.238408 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:42:01.238490 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:42:01.238574 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:42:01.539284 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:42:25.967932 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:42:25.968045 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:42:25.968129 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:42:25.968209 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:42:25.968285 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:42:25.968353 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:42:25.968442 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:42:26.279436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:42:29.022421 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:42:29.022520 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:42:29.022595 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:42:29.022668 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:42:29.022778 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:42:29.022882 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:42:29.022969 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:42:29.340219 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:42:31.795534 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:42:31.795623 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:42:31.795699 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:42:31.795772 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:42:31.795841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:42:31.795907 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:42:31.795976 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:42:32.114439 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:42:59.608147 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:42:59.608258 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:42:59.608339 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:42:59.608416 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:42:59.608495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:42:59.608569 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:42:59.608648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:42:59.912892 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:43:02.383822 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:43:02.383942 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:43:02.384024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:43:02.384098 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:43:02.384170 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:43:02.384250 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:43:02.384327 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:43:02.681759 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:43:26.092516 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:43:26.092612 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:43:26.092686 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:43:26.092791 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:43:26.092856 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:43:26.092924 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:43:26.092999 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:43:26.409316 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:43:30.178850 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:43:30.178965 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:43:30.179050 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:43:30.179127 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:43:30.179204 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:43:30.179297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:43:30.179367 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:43:30.489105 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:43:32.953241 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:43:32.953354 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:43:32.953429 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:43:32.953514 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:43:32.953592 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:43:32.953674 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:43:32.953754 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:43:33.255531 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:44:00.751207 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:44:00.751330 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:44:00.751411 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:44:00.751486 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:44:00.751565 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:44:00.751642 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:44:00.751712 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:44:01.053390 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:44:03.515016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:44:03.515121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:44:03.515200 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:44:03.515263 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:44:03.515337 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:44:03.515405 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:44:03.515469 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:44:03.816810 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:44:26.215969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:44:26.216063 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:44:26.216137 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:44:26.216200 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:44:26.216268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:44:26.216327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:44:26.216394 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:44:26.518778 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:44:31.308091 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:44:31.308196 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:44:31.308283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:44:31.308377 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:44:31.308454 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:44:31.308537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:44:31.308607 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:44:31.609863 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:44:34.075169 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:44:34.075260 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:44:34.075382 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:44:34.075464 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:44:34.075555 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:44:34.075639 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:44:34.075739 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:44:34.386767 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:45:01.877679 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:45:01.877788 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:45:01.877883 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:45:01.877975 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:45:01.878071 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:45:01.878161 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:45:01.878252 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:45:02.203067 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:45:04.649123 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:45:04.649231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:45:04.649307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:45:04.649392 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:45:04.649470 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:45:04.649546 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:45:04.649625 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:45:04.966990 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:45:26.337939 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:45:26.338048 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:45:26.338120 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:45:26.338187 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:45:26.338261 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:45:26.338334 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:45:26.338397 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:45:26.644600 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:45:32.472591 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:45:32.472696 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:45:32.472772 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:45:32.472843 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:45:32.472908 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:45:32.472977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:45:32.473040 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:45:32.775933 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:45:35.236376 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:45:35.236475 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:45:35.236555 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:45:35.236633 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:45:35.236713 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:45:35.236820 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:45:35.236906 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:45:35.542047 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:46:03.041038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:46:03.041161 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:46:03.041237 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:46:03.041328 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:46:03.041409 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:46:03.041493 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:46:03.041572 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:46:03.348655 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:46:05.795926 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:46:05.796039 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:46:05.796125 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:46:05.796203 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:46:05.796290 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:46:05.796374 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:46:05.796453 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:46:06.099069 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:46:26.460517 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:46:26.460617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:46:26.460704 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:46:26.460799 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:46:26.460884 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:46:26.460961 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:46:26.461049 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:46:26.760204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:46:33.615386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:46:33.615521 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:46:33.615598 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:46:33.615686 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:46:33.615769 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:46:33.615847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:46:33.615918 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:46:33.912404 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:46:36.357867 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:46:36.357959 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:46:36.358045 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:46:36.358130 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:46:36.358199 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:46:36.358279 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:46:36.358351 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:46:36.661217 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:47:04.172468 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:47:04.172577 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:47:04.172661 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:47:04.172748 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:47:04.172826 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:47:04.174338 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:47:04.174920 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:47:04.476993 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:47:06.926851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:47:06.926944 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:47:06.927019 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:47:06.927094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:47:06.927163 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:47:06.927229 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:47:06.927311 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:47:07.231023 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:47:26.582334 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:47:26.582440 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:47:26.582517 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:47:26.582596 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:47:26.582681 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:47:26.582767 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:47:26.582845 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:47:26.897763 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:47:34.740849 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:47:34.740972 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:47:34.741048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:47:34.741118 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:47:34.741191 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:47:34.741264 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:47:34.741335 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:47:35.057328 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:47:37.485223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:47:37.485338 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:47:37.485408 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:47:37.485473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:47:37.485542 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:47:37.485600 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:47:37.485681 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:47:37.787111 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:48:05.325591 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:48:05.325707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:48:05.325820 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:48:05.325902 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:48:05.325989 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:48:05.326066 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:48:05.326143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:48:05.629120 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:48:08.046108 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:48:08.046208 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:48:08.046306 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:48:08.046391 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:48:08.046478 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:48:08.046557 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:48:08.046646 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:48:08.354082 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:48:26.703218 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:48:26.703326 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:48:26.703403 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:48:26.703478 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:48:26.703556 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:48:26.703629 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:48:26.703702 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:48:27.011319 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:48:35.896443 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:48:35.896558 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:48:35.896645 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:48:35.896728 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:48:35.896802 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:48:35.896885 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:48:35.896969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:48:36.199145 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:48:38.612834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:48:38.612931 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:48:38.613025 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:48:38.613107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:48:38.613191 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:48:38.613282 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:48:38.613356 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:48:38.913427 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:49:06.455442 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:49:06.455574 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:49:06.455645 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:49:06.455727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:49:06.455800 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:49:06.455869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:49:06.455933 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:49:06.764651 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:49:09.173301 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:49:09.173396 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:49:09.173462 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:49:09.173524 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:49:09.173591 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:49:09.173657 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:49:09.173730 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:49:09.478682 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:49:26.825819 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:49:26.825917 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:49:26.826008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:49:26.826079 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:49:26.826148 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:49:26.826220 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:49:26.826290 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:49:27.135753 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:49:37.024987 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:49:37.025082 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:49:37.025148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:49:37.025213 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:49:37.025285 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:49:37.025347 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:49:37.025419 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:49:37.332821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:49:39.745192 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:49:39.745300 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:49:39.745375 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:49:39.745477 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:49:39.745559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:49:39.745646 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:49:39.745729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:49:40.069603 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:50:07.594318 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:50:07.594421 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:50:07.594502 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:50:07.594573 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:50:07.594648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:50:07.594726 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:50:07.594808 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:50:07.900210 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:50:10.336374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:50:10.336481 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:50:10.336556 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:50:10.336643 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:50:10.336727 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:50:10.336807 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:50:10.336879 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:50:10.639162 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:50:26.952635 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:50:26.953834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:50:26.954441 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:50:26.955173 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:50:26.955712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:50:26.956146 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:50:26.956226 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:50:27.264008 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:50:38.160106 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:50:38.160199 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:50:38.160265 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:50:38.160335 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:50:38.160411 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:50:38.160479 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:50:38.160542 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:50:38.463517 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:50:40.899551 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:50:40.899650 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:50:40.899714 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:50:40.899792 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:50:40.899853 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:50:40.899919 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:50:40.899986 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:50:41.205305 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:51:08.723890 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:51:08.724010 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:51:08.724088 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:51:08.724167 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:51:08.724241 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:51:08.724328 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:51:08.724397 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:51:09.034395 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:51:11.465195 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:51:11.465309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:51:11.465381 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:51:11.465457 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:51:11.465527 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:51:11.465599 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:51:11.465677 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:51:11.770101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:51:27.073335 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:51:27.073413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:51:27.073494 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:51:27.073568 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:51:27.073634 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:51:27.073696 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:51:27.073777 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:51:27.377047 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:51:39.300599 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:51:39.300691 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:51:39.300773 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:51:39.300841 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:51:39.300915 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:51:39.300978 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:51:39.301045 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:51:39.605226 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:51:42.032551 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:51:42.032651 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:51:42.032726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:51:42.032793 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:51:42.032858 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:51:42.032928 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:51:42.032996 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:51:42.356861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:52:09.864827 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:52:09.864913 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:52:09.864993 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:52:09.865060 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:52:09.865121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:52:09.865187 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:52:09.865253 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:52:10.181159 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:52:12.617250 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:52:12.617338 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:52:12.617402 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:52:12.617463 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:52:12.617531 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:52:12.617602 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:52:12.617663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:52:12.923908 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:52:27.192766 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:52:27.192845 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:52:27.192912 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:52:27.192973 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:52:27.193037 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:52:27.193104 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:52:27.193164 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:52:27.496316 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:52:40.439470 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:52:40.439569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:52:40.439636 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:52:40.439699 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:52:40.439773 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:52:40.439834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:52:40.439902 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:52:40.746108 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:52:43.198076 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:52:43.198200 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:52:43.198282 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:52:43.198365 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:52:43.198449 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:52:43.198536 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:52:43.198608 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:52:43.499261 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:53:11.013797 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:53:11.013886 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:53:11.013957 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:53:11.014030 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:53:11.014107 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:53:11.014180 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:53:11.014250 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:53:11.313708 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:53:13.758821 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:53:13.758908 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:53:13.758973 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:53:13.759041 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:53:13.759110 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:53:13.759172 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:53:13.759241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:53:14.073595 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:53:27.316345 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:53:27.316423 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:53:27.316508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:53:27.316573 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:53:27.316642 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:53:27.316704 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:53:27.316773 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:53:27.621682 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:53:41.570477 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:53:41.570569 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:53:41.570631 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:53:41.570697 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:53:41.570767 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:53:41.570833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:53:41.570896 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:53:41.883817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:53:44.339486 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:53:44.339585 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:53:44.339648 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:53:44.339711 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:53:44.339782 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:53:44.339853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:53:44.339911 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:53:44.648926 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:54:12.164514 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:54:12.164598 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:54:12.164662 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:54:12.164734 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:54:12.164802 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:54:12.164868 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:54:12.164935 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:54:12.468053 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:54:14.908926 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:54:14.909022 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:54:14.909107 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:54:14.909177 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:54:14.909259 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:54:14.909340 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:54:14.909414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:54:15.207778 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:54:27.437192 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:54:27.437301 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:54:27.437386 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:54:27.437464 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:54:27.437544 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:54:27.437616 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:54:27.437695 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:54:27.740606 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:54:42.729838 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:54:42.729925 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:54:42.730000 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:54:42.730076 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:54:42.730143 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:54:42.730220 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:54:42.730287 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:54:43.035467 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:54:45.464673 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:54:45.464789 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:54:45.464853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:54:45.464924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:54:45.464983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:54:45.465049 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:54:45.465124 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:54:45.767243 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:55:13.293780 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:55:13.293879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:55:13.293974 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:55:13.294061 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:55:13.294143 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:55:13.294223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:55:13.294310 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:55:13.599487 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:55:16.030291 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:55:16.030390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:55:16.030463 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:55:16.030545 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:55:16.030620 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:55:16.030700 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:55:16.030777 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:55:16.335674 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:55:27.556861 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:55:27.556954 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:55:27.557031 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:55:27.557103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:55:27.557171 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:55:27.557240 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:55:27.557310 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:55:27.862707 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:55:43.862769 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:55:43.862855 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:55:43.862923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:55:43.862987 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:55:43.863053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:55:43.863118 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:55:43.863178 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:55:44.176523 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:55:46.596458 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:55:46.596544 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:55:46.596614 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:55:46.596680 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:55:46.596761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:55:46.596826 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:55:46.596891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:55:46.896525 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:56:14.436366 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:56:14.436464 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:56:14.436528 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:56:14.436603 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:56:14.436666 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:56:14.436742 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:56:14.436811 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:56:14.739212 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:56:17.152471 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:56:17.152577 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:56:17.152661 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:56:17.152744 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:56:17.152845 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:56:17.152925 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:56:17.153007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:56:17.458210 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:56:27.677226 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:56:27.677319 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:56:27.677404 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:56:27.677478 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:56:27.677559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:56:27.677636 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:56:27.677715 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:56:27.984724 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:56:45.002413 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:56:45.002509 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:56:45.002596 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:56:45.002675 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:56:45.002767 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:56:45.002848 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:56:45.002936 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:56:45.319281 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:56:47.722896 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:56:47.722997 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:56:47.723078 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:56:47.723153 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:56:47.723231 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:56:47.723306 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:56:47.723386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:56:48.033795 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:57:15.595643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:57:15.595768 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:57:15.595858 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:57:15.595943 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:57:15.596025 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:57:15.596103 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:57:15.596181 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:57:15.900573 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:57:18.299234 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:57:18.299331 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:57:18.299407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:57:18.299485 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:57:18.299556 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:57:18.299623 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:57:18.299693 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:57:18.605677 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:57:27.797612 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:57:27.797721 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:57:27.797806 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:57:27.797892 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:57:27.797976 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:57:27.798057 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:57:27.798135 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:57:28.103028 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:57:46.155516 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:57:46.155607 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:57:46.155688 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:57:46.155767 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:57:46.155834 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:57:46.155900 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:57:46.155975 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:57:46.456389 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:57:48.870819 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:57:48.870913 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:57:48.870983 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:57:48.871060 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:57:48.871123 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:57:48.871190 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:57:48.871247 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:57:49.182747 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:58:16.714153 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:58:16.714237 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:58:16.714308 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:58:16.714377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:58:16.714439 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:58:16.714504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:58:16.714567 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:58:17.010833 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:58:19.451677 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:58:19.451812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:58:19.451901 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:58:19.451985 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:58:19.452066 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:58:19.452139 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:58:19.452220 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:58:19.756497 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:58:27.919116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:58:27.919200 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:58:27.919285 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:58:27.920481 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:58:27.920887 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:58:27.921646 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:58:27.921855 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:58:28.227380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:58:47.263696 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:58:47.263788 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:58:47.263857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:58:47.263923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:58:47.263989 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:58:47.264059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:58:47.264138 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:58:47.570654 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:58:50.027955 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:58:50.028082 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:58:50.028218 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:58:50.028337 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:58:50.028446 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:58:50.028557 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:58:50.028666 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:58:50.341556 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:59:17.847563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:59:17.847675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:59:17.847767 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:59:17.847869 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:59:17.847954 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:59:17.848042 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:59:17.848123 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:59:18.165489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:59:20.599908 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:59:20.600021 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:59:20.600103 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:59:20.600187 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:59:20.600265 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:59:20.600343 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:59:20.600418 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:59:20.900915 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:59:28.043354 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:59:28.043445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:59:28.043521 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:59:28.043597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:59:28.043683 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:59:28.043759 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:59:28.043841 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:59:28.349156 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:59:48.429732 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:59:48.429839 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:59:48.429909 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:59:48.429996 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:59:48.430064 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:59:48.430136 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:59:48.430204 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:59:48.732862 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 13:59:51.162364 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 13:59:51.162463 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 13:59:51.162537 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 13:59:51.162601 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 13:59:51.162679 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 13:59:51.162746 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 13:59:51.162815 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 13:59:51.465265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:00:19.003838 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:00:19.003938 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:00:19.004011 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:00:19.004076 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:00:19.004146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:00:19.004208 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:00:19.004274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:00:19.321563 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:00:21.729348 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:00:21.729432 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:00:21.729508 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:00:21.729569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:00:21.729641 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:00:21.729725 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:00:21.729788 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:00:22.070388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:00:28.170324 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:00:28.170418 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:00:28.170485 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:00:28.170544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:00:28.170613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:00:28.170676 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:00:28.170755 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:00:28.474164 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:00:49.585122 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:00:49.585233 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:00:49.585359 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:00:49.585464 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:00:49.585549 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:00:49.585636 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:00:49.585739 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:00:49.895021 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:00:52.349754 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:00:52.349865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:00:52.349939 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:00:52.350011 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:00:52.350084 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:00:52.350156 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:00:52.350226 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:00:52.655305 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:01:20.168118 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:01:20.168207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:01:20.168271 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:01:20.168339 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:01:20.168398 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:01:20.168459 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:01:20.168524 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:01:20.476790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:01:22.928547 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:01:22.928653 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:01:22.928715 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:01:22.928788 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:01:22.928850 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:01:22.928918 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:01:22.928992 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:01:23.239598 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:01:28.294350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:01:28.294445 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:01:28.294520 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:01:28.294609 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:01:28.294683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:01:28.294773 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:01:28.294856 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:01:28.595100 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:01:50.741062 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:01:50.741158 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:01:50.741248 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:01:50.741330 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:01:50.741401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:01:50.741491 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:01:50.741564 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:01:51.052568 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:01:53.508727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:01:53.508813 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:01:53.508902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:01:53.508970 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:01:53.509031 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:01:53.509099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:01:53.509174 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:01:53.809496 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:02:21.314298 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:02:21.314399 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:02:21.314475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:02:21.314559 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:02:21.314634 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:02:21.314732 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:02:21.314818 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:02:21.614705 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:02:24.078271 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:02:24.078382 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:02:24.078473 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:02:24.078558 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:02:24.078636 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:02:24.078711 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:02:24.078809 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:02:24.384991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:02:28.422841 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:02:28.422937 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:02:28.423016 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:02:28.423095 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:02:28.423170 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:02:28.423240 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:02:28.423312 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:02:28.726006 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:02:51.879085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:02:51.879186 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:02:51.879256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:02:51.879325 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:02:51.879394 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:02:51.879453 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:02:51.879525 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:02:52.203204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:02:54.648350 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:02:54.648457 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:02:54.648534 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:02:54.648620 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:02:54.648696 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:02:54.648783 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:02:54.648861 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:02:54.956039 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:03:22.465265 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:03:22.465372 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:03:22.465447 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:03:22.466537 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:03:22.467049 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:03:22.467700 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:03:22.467887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:03:22.777440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:03:25.220868 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:03:25.220956 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:03:25.221026 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:03:25.221103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:03:25.221179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:03:25.221243 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:03:25.221307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:03:25.535835 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:03:28.568552 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:03:28.568643 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:03:28.568733 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:03:28.568812 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:03:28.568892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:03:28.568972 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:03:28.569050 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:03:28.871524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:03:53.046030 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:03:53.046128 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:03:53.046194 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:03:53.046272 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:03:53.046348 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:03:53.046418 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:03:53.046490 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:03:53.355390 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:03:55.807080 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:03:55.807165 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:03:55.807237 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:03:55.807304 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:03:55.807366 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:03:55.807427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:03:55.807499 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:03:56.122552 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:04:23.622310 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:04:23.622422 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:04:23.622520 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:04:23.622595 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:04:23.622676 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:04:23.622763 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:04:23.622845 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:04:23.926034 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:04:26.383290 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:04:26.383397 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:04:26.383473 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:04:26.383545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:04:26.383637 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:04:26.383709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:04:26.383801 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:04:26.684940 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:04:28.691670 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:04:28.691764 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:04:28.691834 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:04:28.691909 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:04:28.691976 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:04:28.692044 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:04:28.692112 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:04:29.007871 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:04:54.189813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:04:54.189913 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:04:54.189981 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:04:54.190047 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:04:54.190111 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:04:54.190173 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:04:54.190240 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:04:54.493820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:04:56.952938 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:04:56.953020 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:04:56.953100 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:04:56.953170 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:04:56.953236 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:04:56.953314 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:04:56.953377 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:04:57.256199 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:05:24.756750 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:05:24.756855 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:05:24.756917 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:05:24.756987 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:05:24.757053 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:05:24.757123 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:05:24.757185 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:05:25.072585 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:05:27.508961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:05:27.509048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:05:27.509116 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:05:27.509174 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:05:27.509245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:05:27.509308 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:05:27.509373 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:05:27.812885 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:05:28.820525 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:05:28.820610 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:05:28.820710 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:05:28.820799 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:05:28.820876 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:05:28.820959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:05:28.821038 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:05:29.124929 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:05:55.345391 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:05:55.345483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:05:55.345555 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:05:55.345622 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:05:55.345692 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:05:55.345764 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:05:55.345832 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:05:55.660564 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:05:58.076059 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:05:58.076137 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:05:58.076197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:05:58.076266 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:05:58.076332 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:05:58.076398 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:05:58.076462 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:05:58.377331 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:06:25.926003 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:06:25.926088 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:06:25.926155 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:06:25.926220 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:06:25.926285 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:06:25.926352 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:06:25.926417 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:06:26.237996 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:06:28.633487 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:06:28.633574 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:06:28.633652 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:06:28.633715 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:06:28.633781 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:06:28.633843 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:06:28.633910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:06:28.943839 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:06:29.217630 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:06:29.217710 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:06:29.217787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:06:29.217852 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:06:29.217910 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:06:29.217976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:06:29.218031 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:06:29.530729 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:06:56.503413 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:06:56.503497 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:06:56.503566 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:06:56.503629 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:06:56.503698 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:06:56.503771 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:06:56.503838 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:06:56.800668 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:06:59.219399 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:06:59.219491 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:06:59.219557 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:06:59.219623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:06:59.219685 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:06:59.219756 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:06:59.219819 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:06:59.523749 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:07:27.061072 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:07:27.061165 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:07:27.061250 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:07:27.061328 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:07:27.061402 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:07:27.061481 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:07:27.061561 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:07:27.362145 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:07:29.066901 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:07:29.066996 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:07:29.067076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:07:29.067141 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:07:29.067218 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:07:29.067286 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:07:29.067358 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:07:29.372929 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:07:29.782412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:07:29.782509 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:07:29.782589 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:07:29.782659 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:07:29.782741 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:07:29.782813 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:07:29.782888 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:07:30.093780 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:07:57.621165 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:07:57.621278 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:07:57.621349 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:07:57.621418 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:07:57.621496 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:07:57.621558 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:07:57.621624 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:07:57.936456 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:08:00.358187 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:08:00.358283 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:08:00.358376 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:08:00.358456 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:08:00.358541 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:08:00.358619 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:08:00.358701 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:08:00.658546 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:08:28.197636 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:08:28.197731 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:08:28.197809 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:08:28.197888 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:08:28.197959 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:08:28.198035 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:08:28.198109 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:08:28.503579 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:08:29.195138 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:08:29.195232 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:08:29.195299 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:08:29.195368 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:08:29.195446 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:08:29.195520 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:08:29.195581 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:08:29.510860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:08:30.915323 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:08:30.915423 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:08:30.915508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:08:30.915587 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:08:30.915686 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:08:30.915772 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:08:30.915851 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:08:31.218759 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:08:58.767043 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:08:58.767175 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:08:58.767265 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:08:58.767358 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:08:58.767453 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:08:58.767571 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:08:58.767654 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:08:59.080524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:09:01.484593 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:09:01.484699 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:09:01.484806 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:09:01.484890 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:09:01.484967 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:09:01.485051 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:09:01.485140 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:09:01.795182 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:09:29.320215 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:09:29.320306 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:09:29.320371 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:09:29.320442 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:09:29.320526 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:09:29.320589 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:09:29.320660 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:09:29.630843 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:09:29.886302 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:09:29.886390 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:09:29.886456 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:09:29.886522 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:09:29.886584 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:09:29.886648 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:09:29.886713 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:09:30.195708 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:09:32.085236 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:09:32.085337 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:09:32.085411 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:09:32.085482 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:09:32.085554 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:09:32.085622 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:09:32.085688 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:09:32.394376 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:09:59.888148 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:09:59.888245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:09:59.888330 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:09:59.888408 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:09:59.888485 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:09:59.888558 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:09:59.888647 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:10:00.205611 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:10:02.657032 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:10:02.657585 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:10:02.657670 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:10:02.657752 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:10:02.657831 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:10:02.657905 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:10:02.657981 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:10:02.958637 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:10:29.448918 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:10:29.448998 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:10:29.449072 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:10:29.449140 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:10:29.449207 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:10:29.449274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:10:29.449334 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:10:29.762930 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:10:30.464409 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:10:30.464493 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:10:30.464559 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:10:30.464621 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:10:30.464690 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:10:30.464761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:10:30.464825 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:10:30.766758 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:10:33.221618 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:10:33.221703 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:10:33.221785 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:10:33.221854 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:10:33.221917 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:10:33.221986 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:10:33.222049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:10:33.528426 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:11:01.028873 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:11:01.028955 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:11:01.029025 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:11:01.029087 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:11:01.029152 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:11:01.029212 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:11:01.029278 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:11:01.335941 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:11:03.795704 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:11:03.795813 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:11:03.795875 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:11:03.795935 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:11:03.795996 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:11:03.796074 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:11:03.796134 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:11:04.101401 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:11:29.574320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:11:29.574426 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:11:29.574504 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:11:29.574581 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:11:29.574668 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:11:29.574744 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:11:29.574814 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:11:29.883074 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:11:31.595705 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:11:31.595814 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:11:31.595894 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:11:31.595971 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:11:31.596051 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:11:31.596119 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:11:31.596195 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:11:31.899073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:11:34.367051 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:11:34.367135 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:11:34.367208 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:11:34.367281 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:11:34.367346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:11:34.367409 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:11:34.367469 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:11:34.677625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:12:02.175627 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:12:02.175768 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:12:02.175871 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:12:02.175978 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:12:02.176075 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:12:02.176182 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:12:02.176286 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:12:02.485221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:12:04.947175 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:12:04.947281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:12:04.947354 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:12:04.947418 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:12:04.947481 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:12:04.947538 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:12:04.947601 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:12:05.259236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:12:29.693714 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:12:29.693803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:12:29.693876 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:12:29.693938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:12:29.694004 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:12:29.694068 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:12:29.694129 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:12:30.010850 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:12:32.748685 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:12:32.748850 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:12:32.749007 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:12:32.749167 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:12:32.749298 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:12:32.749907 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:12:32.750035 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:12:33.065279 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:12:35.521206 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:12:35.521290 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:12:35.521364 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:12:35.521434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:12:35.521494 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:12:35.521564 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:12:35.521631 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:12:35.825448 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:13:03.327092 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:13:03.327197 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:13:03.327281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:13:03.327352 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:13:03.327427 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:13:03.327507 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:13:03.327588 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:13:03.628607 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:13:06.084669 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:13:06.084809 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:13:06.084901 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:13:06.084981 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:13:06.085055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:13:06.085139 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:13:06.085214 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:13:06.382482 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:13:29.819327 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:13:29.819450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:13:29.819525 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:13:29.819593 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:13:29.819665 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:13:29.819742 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:13:29.819831 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:13:30.133705 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:13:33.889142 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:13:33.889237 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:13:33.889318 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:13:33.889394 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:13:33.889470 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:13:33.889541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:13:33.889629 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:13:34.208320 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:13:36.640343 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:13:36.640434 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:13:36.640508 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:13:36.640587 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:13:36.640683 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:13:36.640789 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:13:36.640864 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:13:36.945487 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:14:04.470981 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:14:04.471073 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:14:04.471139 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:14:04.471218 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:14:04.471287 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:14:04.471363 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:14:04.471430 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:14:04.776856 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:14:07.200914 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:14:07.201008 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:14:07.201074 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:14:07.201139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:14:07.201199 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:14:07.201263 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:14:07.201324 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:14:07.508129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:14:29.946623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:14:29.946707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:14:29.946778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:14:29.946846 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:14:29.946908 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:14:29.946975 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:14:29.947035 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:14:30.260558 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:14:35.046971 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:14:35.047066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:14:35.047130 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:14:35.047198 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:14:35.047256 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:14:35.047328 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:14:35.047392 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:14:35.354499 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:14:37.768888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:14:37.768978 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:14:37.769061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:14:37.769129 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:14:37.769199 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:14:37.769267 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:14:37.769332 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:14:38.078246 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:15:05.615904 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:15:05.615986 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:15:05.616056 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:15:05.616131 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:15:05.616197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:15:05.616266 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:15:05.616331 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:15:05.919401 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:15:08.338522 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:15:08.338634 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:15:08.338704 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:15:08.338774 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:15:08.338841 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:15:08.338902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:15:08.338964 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:15:08.644196 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:15:30.074556 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:15:30.074644 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:15:30.074715 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:15:30.074790 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:15:30.074861 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:15:30.074925 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:15:30.075003 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:15:30.387553 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:15:36.187672 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:15:36.187769 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:15:36.187836 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:15:36.187901 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:15:36.187971 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:15:36.188031 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:15:36.188092 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:15:36.493244 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:15:38.904233 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:15:38.904318 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:15:38.904401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:15:38.904466 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:15:38.904534 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:15:38.904591 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:15:38.904656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:15:39.216724 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:16:06.755940 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:16:06.756043 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:16:06.756112 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:16:06.756181 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:16:06.756251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:16:06.756323 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:16:06.756387 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:16:07.064417 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:16:09.475813 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:16:09.475904 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:16:09.475970 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:16:09.476042 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:16:09.476110 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:16:09.476177 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:16:09.476248 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:16:09.782199 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:16:30.197953 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:16:30.198039 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:16:30.198108 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:16:30.198179 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:16:30.198242 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:16:30.198311 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:16:30.198374 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:16:30.504403 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:16:37.324031 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:16:37.324118 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:16:37.324193 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:16:37.324258 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:16:37.324326 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:16:37.324387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:16:37.324451 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:16:37.633001 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:16:40.042092 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:16:40.042179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:16:40.042244 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:16:40.042309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:16:40.042375 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:16:40.042437 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:16:40.042504 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:16:40.352765 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:17:07.904247 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:17:07.904346 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:17:07.904437 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:17:07.904522 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:17:07.904603 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:17:07.904683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:17:07.904791 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:17:08.211630 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:17:10.616649 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:17:10.616767 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:17:10.616834 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:17:10.616910 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:17:10.616975 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:17:10.617061 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:17:10.617127 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:17:10.930523 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:17:30.324894 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:17:30.324978 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:17:30.325051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:17:30.325112 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:17:30.325179 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:17:30.325240 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:17:30.325306 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:17:30.628390 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:17:38.477013 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:17:38.477103 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:17:38.477171 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:17:38.477236 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:17:38.477297 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:17:38.477375 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:17:38.477442 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:17:38.788821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:17:41.189297 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:17:41.189406 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:17:41.189476 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:17:41.189547 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:17:41.189605 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:17:41.189670 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:17:41.189737 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:17:41.499038 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:18:09.049792 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:18:09.049883 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:18:09.049953 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:18:09.050014 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:18:09.050078 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:18:09.050149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:18:09.050211 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:18:09.361429 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:18:11.761489 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:18:11.762156 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:18:11.762788 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:18:11.763573 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:18:11.763663 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:18:11.763742 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:18:11.763812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:18:12.087544 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:18:30.450843 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:18:30.450932 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:18:30.450996 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:18:30.451061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:18:30.451125 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:18:30.451193 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:18:30.451259 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:18:30.751308 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:18:39.624179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:18:39.624283 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:18:39.624349 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:18:39.624417 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:18:39.624488 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:18:39.624558 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:18:39.624619 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:18:39.938055 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:18:42.369152 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:18:42.369240 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:18:42.369302 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:18:42.369375 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:18:42.369450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:18:42.369511 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:18:42.369579 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:18:42.676591 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:19:10.211076 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:19:10.211163 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:19:10.211226 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:19:10.211286 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:19:10.211349 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:19:10.211413 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:19:10.211477 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:19:10.516530 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:19:12.945222 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:19:12.945305 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:19:12.945371 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:19:12.945435 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:19:12.945502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:19:12.945565 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:19:12.945628 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:19:13.252192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:19:30.586068 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:19:30.586217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:19:30.586295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:19:30.586373 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:19:30.586454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:19:30.586531 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:19:30.586611 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:19:30.894949 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:19:40.779013 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:19:40.779102 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:19:40.779179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:19:40.779253 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:19:40.779326 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:19:40.779390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:19:40.779466 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:19:41.098677 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:19:43.519840 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:19:43.519922 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:19:43.519993 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:19:43.520057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:19:43.520128 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:19:43.520191 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:19:43.520256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:19:43.827545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:20:11.357297 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:20:11.357398 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:20:11.357483 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:20:11.357559 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:20:11.357642 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:20:11.357710 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:20:11.357789 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:20:11.662830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:20:14.092046 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:20:14.092146 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:20:14.092215 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:20:14.092287 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:20:14.092356 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:20:14.092426 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:20:14.092499 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:20:14.398779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:20:30.722852 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:20:30.722929 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:20:30.723001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:20:30.723061 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:20:30.723125 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:20:30.723193 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:20:30.723266 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:20:31.036232 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:20:41.924140 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:20:41.924239 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:20:41.924319 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:20:41.924405 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:20:41.924473 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:20:41.924542 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:20:41.924616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:20:42.261736 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:20:44.656915 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:20:44.657027 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:20:44.657097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:20:44.657167 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:20:44.657243 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:20:44.657315 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:20:44.657382 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:20:44.963594 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:21:12.520114 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:21:12.520199 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:21:12.520265 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:21:12.520332 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:21:12.520401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:21:12.520460 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:21:12.520524 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:21:12.823151 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:21:15.230200 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:21:15.230281 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:21:15.230351 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:21:15.230411 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:21:15.230476 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:21:15.230537 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:21:15.230599 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:21:15.540147 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:21:30.850201 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:21:30.850315 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:21:30.850401 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:21:30.850489 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:21:30.850578 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:21:30.850663 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:21:30.850760 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:21:31.159632 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:21:43.091121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:21:43.091214 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:21:43.091297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:21:43.091371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:21:43.091447 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:21:43.091513 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:21:43.091586 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:21:43.398870 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:21:45.796746 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:21:45.796840 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:21:45.796907 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:21:45.796968 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:21:45.797046 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:21:45.797107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:21:45.797169 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:21:46.104259 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:22:13.656817 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:22:13.656916 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:22:13.656977 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:22:13.657042 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:22:13.657099 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:22:13.657164 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:22:13.657226 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:22:13.974298 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:22:16.366356 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:22:16.366446 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:22:16.366524 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:22:16.366588 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:22:16.366657 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:22:16.366721 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:22:16.366779 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:22:16.668798 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:22:30.974683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:22:30.974765 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:22:30.974834 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:22:30.974900 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:22:30.974961 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:22:30.975022 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:22:30.975088 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:22:31.281105 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:22:44.244760 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:22:44.244847 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:22:44.244917 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:22:44.244984 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:22:44.245049 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:22:44.245111 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:22:44.245173 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:22:44.549348 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:22:46.926546 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:22:46.926641 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:22:46.926714 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:22:46.926782 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:22:46.926846 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:22:46.926905 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:22:46.926967 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:22:47.232229 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:23:14.812916 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:23:14.812997 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:23:14.813068 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:23:14.813133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:23:14.813193 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:23:14.813259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:23:14.813323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:23:15.122262 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:23:17.495847 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:23:17.495949 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:23:17.496026 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:23:17.496096 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:23:17.496161 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:23:17.496235 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:23:17.496308 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:23:17.812188 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:23:31.106532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:23:31.106618 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:23:31.106684 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:23:31.106754 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:23:31.106815 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:23:31.106881 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:23:31.106940 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:23:31.418129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:23:45.382705 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:23:45.382794 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:23:45.382869 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:23:45.382934 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:23:45.382998 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:23:45.383066 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:23:45.383128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:23:45.684544 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:23:48.079749 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:23:48.079857 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:23:48.079937 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:23:48.080022 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:23:48.080096 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:23:48.080165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:23:48.080234 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:23:48.385094 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:24:15.947216 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:24:15.947307 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:24:15.947372 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:24:15.947434 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:24:15.947500 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:24:15.947563 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:24:15.947626 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:24:16.256513 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:24:18.647731 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:24:18.647819 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:24:18.647884 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:24:18.647946 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:24:18.648012 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:24:18.648072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:24:18.648136 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:24:18.950128 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:24:31.231308 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:24:31.231390 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:24:31.231458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:24:31.231526 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:24:31.231590 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:24:31.231661 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:24:31.231738 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:24:31.541552 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:24:46.516267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:24:46.516355 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:24:46.516425 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:24:46.516509 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:24:46.516575 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:24:46.516636 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:24:46.516703 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:24:46.820976 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:24:49.230820 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:24:49.230904 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:24:49.230969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:24:49.231047 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:24:49.231105 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:24:49.231171 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:24:49.231231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:24:49.535219 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:25:17.086382 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:25:17.086501 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:25:17.086588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:25:17.086679 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:25:17.086758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:25:17.086836 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:25:17.086904 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:25:17.398461 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:25:19.789711 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:25:19.789802 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:25:19.789873 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:25:19.789936 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:25:19.790002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:25:19.790066 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:25:19.790127 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:25:20.110801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:25:31.354412 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:25:31.354522 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:25:31.354597 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:25:31.354670 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:25:31.354758 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:25:31.354837 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:25:31.354910 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:25:31.657987 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:25:47.657742 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:25:47.657824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:25:47.657889 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:25:47.657955 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:25:47.658019 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:25:47.658080 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:25:47.658148 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:25:47.969415 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:25:50.378256 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:25:50.378368 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:25:50.378439 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:25:50.378505 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:25:50.378561 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:25:50.378632 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:25:50.378693 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:25:50.686731 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:26:18.230566 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:26:18.230663 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:26:18.230740 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:26:18.230806 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:26:18.230875 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:26:18.230944 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:26:18.231005 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:26:18.537879 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:26:20.957407 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:26:20.957521 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:26:20.957604 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:26:20.957746 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:26:20.957843 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:26:20.957919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:26:20.958000 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:26:21.257625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:26:31.482320 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:26:31.482428 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:26:31.482514 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:26:31.482598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:26:31.482686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:26:31.482785 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:26:31.482869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:26:31.782800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:26:48.797897 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:26:48.798013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:26:48.798091 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:26:48.798164 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:26:48.798242 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:26:48.798327 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:26:48.798407 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:26:49.116048 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:26:51.519419 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:26:51.519534 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:26:51.519612 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:26:51.519699 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:26:51.519777 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:26:51.519855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:26:51.519929 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:26:51.820433 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:27:19.402958 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:27:19.403074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:27:19.403151 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:27:19.403233 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:27:19.403318 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:27:19.403396 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:27:19.403473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:27:19.706423 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:27:22.097506 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:27:22.097616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:27:22.097704 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:27:22.097794 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:27:22.097888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:27:22.097971 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:27:22.098059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:27:22.403928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:27:31.608758 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:27:31.608853 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:27:31.608938 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:27:31.609008 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:27:31.609095 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:27:31.609190 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:27:31.609266 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:27:31.923628 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:27:49.974778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:27:49.974896 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:27:49.974977 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:27:49.975051 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:27:49.975130 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:27:49.975204 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:27:49.975290 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:27:50.296377 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:27:52.666764 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:27:52.666869 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:27:52.666942 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:27:52.667016 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:27:52.667090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:27:52.667167 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:27:52.667243 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:27:52.972807 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:28:20.557766 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:28:20.557851 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:28:20.557945 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:28:20.558008 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:28:20.558072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:28:20.558135 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:28:20.558194 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:28:20.861552 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:28:23.234510 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:28:23.234616 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:28:23.234696 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:28:23.234804 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:28:23.234879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:28:23.234961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:28:23.235037 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:28:23.542446 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:28:31.729274 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:28:31.729369 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:28:31.729445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:28:31.729523 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:28:31.729601 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:28:31.729675 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:28:31.729774 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:28:32.034459 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:28:51.134274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:28:51.134367 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:28:51.134450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:28:51.134532 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:28:51.134598 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:28:51.134664 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:28:51.134754 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:28:51.442314 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:28:53.800917 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:28:53.801018 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:28:53.801103 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:28:53.801175 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:28:53.801245 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:28:53.801311 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:28:53.801373 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:28:54.129914 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:29:21.706133 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:29:21.706236 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:29:21.706304 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:29:21.706370 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:29:21.706437 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:29:21.706499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:29:21.706570 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:29:22.012149 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:29:24.409707 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:29:24.409815 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:29:24.409894 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:29:24.409960 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:29:24.410021 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:29:24.410084 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:29:24.410146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:29:24.716920 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:29:31.843938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:29:31.844019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:29:31.844085 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:29:31.844154 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:29:31.844216 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:29:31.844283 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:29:31.844349 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:29:32.161917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:29:52.291160 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:29:52.291264 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:29:52.291333 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:29:52.291401 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:29:52.291479 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:29:52.291541 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:29:52.291607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:29:52.597263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:29:54.978733 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:29:54.978826 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:29:54.978928 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:29:54.979007 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:29:54.979085 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:29:54.979152 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:29:54.979238 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:29:55.291486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:30:22.865143 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:30:22.865236 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:30:22.865307 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:30:22.865384 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:30:22.865458 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:30:22.865533 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:30:22.865598 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:30:23.175364 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:30:25.554946 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:30:25.555062 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:30:25.555140 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:30:25.555218 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:30:25.555306 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:30:25.555387 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:30:25.555465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:30:25.854101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:30:31.964937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:30:31.965034 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:30:31.965111 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:30:31.965191 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:30:31.965266 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:30:31.965349 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:30:31.965423 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:30:32.286069 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:30:53.449823 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:30:53.449929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:30:53.450014 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:30:53.450079 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:30:53.450148 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:30:53.450212 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:30:53.450287 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:30:53.760263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:30:56.108063 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:30:56.108435 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:30:56.109143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:30:56.109651 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:30:56.110399 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:30:56.110507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:30:56.110590 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:30:56.410112 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:31:24.027930 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:31:24.028047 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:31:24.028119 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:31:24.028184 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:31:24.028254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:31:24.028321 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:31:24.028386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:31:24.338516 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:31:26.662823 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:31:26.662919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:31:26.662986 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:31:26.663048 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:31:26.663114 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:31:26.663178 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:31:26.663249 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:31:26.978956 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:31:32.088917 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:31:32.088994 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:31:32.089071 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:31:32.089139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:31:32.089207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:31:32.089270 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:31:32.089334 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:31:32.392628 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:31:54.601890 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:31:54.601971 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:31:54.602035 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:31:54.602100 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:31:54.602160 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:31:54.602234 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:31:54.602297 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:31:54.901509 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:31:57.233981 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:31:57.234077 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:31:57.234148 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:31:57.234212 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:31:57.234277 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:31:57.234342 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:31:57.234403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:31:57.539768 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:32:25.174182 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:32:25.174306 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:32:25.174386 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:32:25.174466 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:32:25.174540 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:32:25.174621 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:32:25.174692 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:32:25.481462 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:32:27.801692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:32:27.801801 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:32:27.801874 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:32:27.801960 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:32:27.802037 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:32:27.802118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:32:27.802192 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:32:28.099939 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:32:32.210616 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:32:32.210705 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:32:32.210790 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:32:32.210863 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:32:32.210936 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:32:32.211007 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:32:32.211077 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:32:32.513651 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:32:55.737208 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:32:55.737309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:32:55.737375 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:32:55.737440 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:32:55.737499 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:32:55.737565 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:32:55.737631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:32:56.040400 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:32:58.358466 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:32:58.358577 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:32:58.358646 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:32:58.358726 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:32:58.358790 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:32:58.358870 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:32:58.358932 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:32:58.661781 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:33:26.305095 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:33:26.305621 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:33:26.306330 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:33:26.306773 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:33:26.306892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:33:26.306971 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:33:26.307051 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:33:26.613861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:33:28.926306 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:33:28.926397 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:33:28.926468 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:33:28.926535 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:33:28.926604 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:33:28.926678 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:33:28.926748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:33:29.260233 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:33:32.331818 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:33:32.331895 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:33:32.331959 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:33:32.332029 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:33:32.332094 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:33:32.332157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:33:32.332224 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:33:32.633021 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:33:56.872530 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:33:56.872648 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:33:56.872734 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:33:56.872809 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:33:56.872881 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:33:56.872957 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:33:56.873020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:33:57.187350 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:33:59.523582 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:33:59.523669 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:33:59.523737 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:33:59.523802 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:33:59.523869 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:33:59.523937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:33:59.523997 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:33:59.828502 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:34:27.446553 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:34:27.446637 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:34:27.446712 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:34:27.446780 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:34:27.446843 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:34:27.446907 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:34:27.446973 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:34:27.751625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:34:30.101093 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:34:30.101207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:34:30.101292 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:34:30.101364 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:34:30.102469 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:34:30.102935 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:34:30.103397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:34:30.403947 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:34:32.456328 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:34:32.456415 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:34:32.456490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:34:32.456566 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:34:32.456633 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:34:32.456706 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:34:32.456777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:34:32.761235 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:34:58.015082 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:34:58.015171 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:34:58.015242 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:34:58.015306 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:34:58.015365 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:34:58.015429 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:34:58.015496 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:34:58.327169 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:35:00.658520 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:35:00.658606 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:35:00.658679 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:35:00.658750 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:35:00.658817 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:35:00.658891 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:35:00.658952 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:35:00.977913 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:35:28.591658 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:35:28.591754 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:35:28.591822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:35:28.591881 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:35:28.591946 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:35:28.592021 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:35:28.592083 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:35:28.898899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:35:31.258187 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:35:31.258299 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:35:31.258384 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:35:31.258464 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:35:31.258537 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:35:31.258620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:35:31.258696 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:35:31.565111 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:35:32.581466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:35:32.581559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:35:32.581646 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:35:32.581716 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:35:32.581801 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:35:32.581871 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:35:32.581943 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:35:32.889685 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:35:59.165392 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:35:59.165508 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:35:59.165578 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:35:59.165643 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:35:59.165709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:35:59.165780 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:35:59.165847 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:35:59.475371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:36:01.827473 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:36:01.827563 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:36:01.827648 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:36:01.827726 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:36:01.827814 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:36:01.827898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:36:01.827980 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:36:02.132549 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:36:29.735320 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:36:29.735407 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:36:29.735493 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:36:29.735575 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:36:29.735646 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:36:29.735726 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:36:29.735805 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:36:30.051084 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:36:32.401929 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:36:32.402033 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:36:32.402114 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:36:32.402194 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:36:32.402267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:36:32.402344 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:36:32.402412 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:36:32.714000 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:36:32.981777 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:36:32.981869 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:36:32.981945 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:36:32.982019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:36:32.982094 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:36:32.982167 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:36:32.982245 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:36:33.291342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:37:00.319282 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:37:00.319410 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:37:00.319494 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:37:00.319591 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:37:00.319664 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:37:00.319758 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:37:00.319850 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:37:00.619504 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:37:02.982675 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:37:02.982803 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:37:02.982872 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:37:02.982943 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:37:02.983004 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:37:02.983075 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:37:02.983138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:37:03.291912 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:37:30.882646 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:37:30.882768 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:37:30.882848 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:37:30.882928 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:37:30.883006 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:37:30.883086 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:37:30.883162 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:37:31.192947 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:37:32.825007 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:37:32.825119 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:37:32.825197 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:37:32.825278 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:37:32.825357 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:37:32.825437 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:37:32.825512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:37:33.134917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:37:33.553115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:37:33.553223 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:37:33.553311 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:37:33.553395 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:37:33.553476 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:37:33.553547 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:37:33.553625 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:37:33.848132 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:38:01.455453 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:38:01.455547 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:38:01.455625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:38:01.455701 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:38:01.455797 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:38:01.455872 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:38:01.455947 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:38:01.762743 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:38:04.105490 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:38:04.105613 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:38:04.105679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:38:04.105751 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:38:04.105818 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:38:04.105886 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:38:04.105948 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:38:04.431224 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:38:32.028760 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:38:32.028854 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:38:32.028921 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:38:32.028991 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:38:32.029053 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:38:32.029118 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:38:32.029183 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:38:32.338784 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:38:32.954979 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:38:32.955060 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:38:32.955128 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:38:32.955195 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:38:32.955263 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:38:32.955328 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:38:32.955383 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:38:33.261033 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:38:34.692603 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:38:34.692690 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:38:34.692766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:38:34.692834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:38:34.692906 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:38:34.692974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:38:34.693035 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:38:35.004205 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:39:02.596521 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:39:02.596606 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:39:02.596666 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:39:02.596763 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:39:02.596844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:39:02.596913 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:39:02.596972 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:39:02.905826 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:39:05.267659 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:39:05.267788 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:39:05.267866 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:39:05.267960 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:39:05.268040 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:39:05.268115 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:39:05.268197 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:39:05.580499 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:39:33.078425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:39:33.078514 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:39:33.078585 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:39:33.078662 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:39:33.078731 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:39:33.078808 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:39:33.078876 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:39:33.388785 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:39:33.651807 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:39:33.651891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:39:33.651954 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:39:33.652024 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:39:33.652089 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:39:33.652152 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:39:33.652212 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:39:33.958446 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:39:35.839846 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:39:35.839949 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:39:35.840007 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:39:35.840070 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:39:35.840133 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:39:35.840186 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:39:35.840251 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:39:36.143873 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:40:03.653056 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:40:03.653156 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:40:03.653219 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:40:03.653285 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:40:03.653345 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:40:03.653407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:40:03.653461 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:40:03.966729 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:40:06.402463 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:40:06.402542 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:40:06.403129 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:40:06.403573 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:40:06.403697 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:40:06.403843 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:40:06.404138 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:40:06.709800 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:40:33.203115 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:40:33.203196 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:40:33.203257 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:40:33.203323 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:40:33.203384 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:40:33.203452 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:40:33.203515 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:40:33.509662 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:40:34.249192 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:40:34.249279 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:40:34.249352 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:40:34.249424 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:40:34.249495 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:40:34.249571 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:40:34.249640 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:40:34.561627 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:40:36.976374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:40:36.976475 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:40:36.976558 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:40:36.976644 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:40:36.976728 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:40:36.976816 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:40:36.976903 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:40:37.284065 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:41:04.825355 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:41:04.825451 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:41:04.825530 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:41:04.825615 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:41:04.825678 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:41:04.825766 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:41:04.825841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:41:05.145666 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:41:07.542214 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:41:07.542322 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:41:07.542385 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:41:07.542449 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:41:07.542522 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:41:07.542598 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:41:07.542662 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:41:07.843601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:41:33.327491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:41:33.327567 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:41:33.327634 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:41:33.327698 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:41:33.327775 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:41:33.327835 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:41:33.327902 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:41:33.640070 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:41:35.421569 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:41:35.421672 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:41:35.421744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:41:35.421804 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:41:35.421869 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:41:35.421929 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:41:35.421997 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:41:35.721198 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:41:38.105326 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:41:38.105408 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:41:38.105481 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:41:38.105542 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:41:38.105609 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:41:38.105673 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:41:38.105740 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:41:38.411382 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:42:05.978499 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:42:05.978598 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:42:05.978664 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:42:05.978724 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:42:05.978790 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:42:05.978851 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:42:05.978912 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:42:06.294650 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:42:08.674517 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:42:08.674627 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:42:08.674716 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:42:08.674803 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:42:08.674889 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:42:08.674978 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:42:08.675059 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:42:08.988860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:42:33.453796 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:42:33.453899 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:42:33.454048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:42:33.454125 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:42:33.454208 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:42:33.454287 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:42:33.454369 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:42:33.757890 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:42:36.555673 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:42:36.555799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:42:36.555867 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:42:36.555939 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:42:36.556006 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:42:36.556077 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:42:36.556144 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:42:36.857329 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:42:39.250789 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:42:39.250871 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:42:39.250954 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:42:39.251017 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:42:39.251082 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:42:39.251149 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:42:39.251212 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:42:39.556169 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:43:07.120068 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:43:07.120152 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:43:07.120230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:43:07.120288 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:43:07.120352 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:43:07.120412 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:43:07.120472 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:43:07.424010 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:43:09.824382 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:43:09.824488 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:43:09.824554 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:43:09.824617 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:43:09.824677 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:43:09.824754 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:43:09.824819 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:43:10.140076 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:43:33.573299 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:43:33.573382 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:43:33.573459 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:43:33.573525 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:43:33.573598 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:43:33.573658 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:43:33.573728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:43:33.884265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:43:37.688933 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:43:37.689041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:43:37.689119 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:43:37.689193 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:43:37.689263 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:43:37.689333 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:43:37.689400 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:43:37.999268 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:43:40.407192 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:43:40.407307 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:43:40.407386 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:43:40.407473 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:43:40.407556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:43:40.407638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:43:40.407724 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:43:40.705912 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:44:08.261486 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:44:08.261586 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:44:08.261665 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:44:08.261757 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:44:08.261834 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:44:08.261928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:44:08.262001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:44:08.573926 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:44:10.961788 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:44:10.961896 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:44:10.961955 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:44:10.962021 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:44:10.962084 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:44:10.962148 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:44:10.962209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:44:11.267268 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:44:33.694858 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:44:33.694952 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:44:33.695014 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:44:33.695083 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:44:33.695149 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:44:33.695213 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:44:33.695273 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:44:33.998098 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:44:38.836822 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:44:38.836947 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:44:38.837030 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:44:38.837105 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:44:38.837199 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:44:38.837278 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:44:38.837360 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:44:39.140662 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:44:41.534922 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:44:41.535025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:44:41.535102 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:44:41.535179 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:44:41.535265 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:44:41.535342 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:44:41.536683 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:44:41.840820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:45:09.406295 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:45:09.406385 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:45:09.406459 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:45:09.406525 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:45:09.406597 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:45:09.406666 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:45:09.406735 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:45:09.710147 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:45:12.108464 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:45:12.108588 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:45:12.108681 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:45:12.108787 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:45:12.108883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:45:12.108965 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:45:12.109041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:45:12.421762 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:45:33.818857 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:45:33.818937 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:45:33.819008 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:45:33.819077 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:45:33.819136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:45:33.819200 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:45:33.819262 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:45:34.127243 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:45:39.981371 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:45:39.981466 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:45:39.981532 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:45:39.981610 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:45:39.981672 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:45:39.981751 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:45:39.981818 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:45:40.299450 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:45:42.681903 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:45:42.681989 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:45:42.682064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:45:42.682135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:45:42.682203 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:45:42.682271 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:45:42.682336 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:45:42.991632 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:46:10.559992 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:46:10.560120 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:46:10.560183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:46:10.560260 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:46:10.560330 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:46:10.560395 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:46:10.560455 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:46:10.859844 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:46:13.248470 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:46:13.248568 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:46:13.248635 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:46:13.248703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:46:13.248774 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:46:13.248844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:46:13.248899 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:46:13.559807 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:46:33.937245 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:46:33.937324 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:46:33.937391 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:46:33.937455 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:46:33.937520 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:46:33.937584 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:46:33.937645 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:46:34.245858 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:46:41.122124 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:46:41.122218 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:46:41.122288 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:46:41.122365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:46:41.122434 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:46:41.122506 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:46:41.122571 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:46:41.435791 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:46:43.819730 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:46:43.819817 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:46:43.819891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:46:43.819959 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:46:43.820025 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:46:43.820085 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:46:43.820157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:46:44.127861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:47:11.695054 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:47:11.695151 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:47:11.695215 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:47:11.695279 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:47:11.695345 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:47:11.695406 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:47:11.695469 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:47:11.999779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:47:14.396917 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:47:14.397032 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:47:14.397119 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:47:14.397205 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:47:14.397282 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:47:14.397364 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:47:14.397438 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:47:14.697008 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:47:34.061125 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:47:34.061216 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:47:34.061296 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:47:34.061376 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:47:34.061458 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:47:34.061537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:47:34.061616 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:47:34.366347 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:47:42.273229 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:47:42.273333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:47:42.273417 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:47:42.273492 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:47:42.273573 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:47:42.273655 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:47:42.273735 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:47:42.579060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:47:44.954577 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:47:44.954713 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:47:44.954794 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:47:44.954869 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:47:44.954943 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:47:44.955008 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:47:44.955075 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:47:45.262265 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:48:12.840863 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:48:12.840962 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:48:12.841033 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:48:12.841097 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:48:12.841161 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:48:12.841228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:48:12.841298 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:48:13.137630 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:48:15.523095 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:48:15.523548 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:48:15.524284 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:48:15.524403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:48:15.524477 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:48:15.524546 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:48:15.524639 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:48:15.833380 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:48:34.184657 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:48:34.184773 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:48:34.184893 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:48:34.184981 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:48:34.185075 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:48:34.185160 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:48:34.185245 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:48:34.496527 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:48:43.393696 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:48:43.393835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:48:43.393906 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:48:43.393975 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:48:43.394064 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:48:43.394132 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:48:43.394202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:48:43.700472 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:48:46.098947 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:48:46.099061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:48:46.099149 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:48:46.099234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:48:46.099308 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:48:46.099394 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:48:46.099465 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:48:46.403914 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:49:13.970229 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:49:13.970328 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:49:13.970398 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:49:13.970465 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:49:13.970534 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:49:13.970606 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:49:13.970665 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:49:14.276992 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:49:16.664436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:49:16.664536 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:49:16.664610 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:49:16.664691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:49:16.664765 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:49:16.664838 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:49:16.664911 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:49:16.964506 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:49:34.306664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:49:34.306740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:49:34.306813 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:49:34.306877 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:49:34.306936 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:49:34.306998 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:49:34.307062 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:49:34.615842 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:49:44.540861 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:49:44.540951 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:49:44.541020 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:49:44.541080 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:49:44.541145 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:49:44.541205 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:49:44.541265 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:49:44.846589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:49:47.229278 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:49:47.229358 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:49:47.229438 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:49:47.229502 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:49:47.229569 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:49:47.229630 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:49:47.229694 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:49:47.536682 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:50:15.107864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:50:15.107978 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:50:15.108042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:50:15.108104 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:50:15.108170 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:50:15.108236 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:50:15.108296 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:50:15.416515 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:50:17.803976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:50:17.804064 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:50:17.804131 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:50:17.804194 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:50:17.804267 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:50:17.804324 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:50:17.804389 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:50:18.114826 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:50:34.428941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:50:34.429048 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:50:34.429119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:50:34.429993 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:50:34.430225 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:50:34.430556 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:50:34.430877 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:50:34.745629 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:50:45.691039 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:50:45.691126 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:50:45.691202 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:50:45.691274 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:50:45.691347 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:50:45.691417 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:50:45.691503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:50:46.000196 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:50:48.380278 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:50:48.380362 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:50:48.380428 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:50:48.380494 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:50:48.380564 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:50:48.380631 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:50:48.380693 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:50:48.683107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:51:16.265097 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:51:16.265185 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:51:16.265254 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:51:16.265319 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:51:16.265380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:51:16.265441 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:51:16.265507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:51:16.571171 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:51:18.942338 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:51:18.942429 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:51:18.942506 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:51:18.942576 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:51:18.942641 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:51:18.942708 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:51:18.942788 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:51:19.253199 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:51:34.552477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:51:34.552554 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:51:34.552621 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:51:34.552683 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:51:34.552749 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:51:34.552815 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:51:34.552882 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:51:34.865977 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:51:46.826223 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:51:46.826324 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:51:46.826397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:51:46.826488 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:51:46.826556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:51:46.826628 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:51:46.827651 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:51:47.128410 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:51:49.509780 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:51:49.509905 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:51:49.509991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:51:49.510072 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:51:49.510149 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:51:49.510226 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:51:49.510303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:51:49.808154 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:52:17.389003 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:52:17.389095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:52:17.389178 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:52:17.389255 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:52:17.389329 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:52:17.389396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:52:17.389468 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:52:17.696935 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:52:20.096448 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:52:20.096544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:52:20.096614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:52:20.096680 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:52:20.096766 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:52:20.096831 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:52:20.096907 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:52:20.401635 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:52:34.674091 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:52:34.674179 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:52:34.674247 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:52:34.674323 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:52:34.674388 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:52:34.674456 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:52:34.674521 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:52:34.986948 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:52:47.967335 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:52:47.967444 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:52:47.967548 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:52:47.967635 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:52:47.967730 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:52:47.967818 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:52:47.967900 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:52:48.271233 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:52:50.657106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:52:50.657204 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:52:50.657286 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:52:50.657371 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:52:50.657450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:52:50.657523 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:52:50.657617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:52:50.955513 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:53:18.531588 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:53:18.531701 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:53:18.531793 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:53:18.531873 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:53:18.531960 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:53:18.532032 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:53:18.532116 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:53:18.831358 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:53:21.214059 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:53:21.214158 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:53:21.214230 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:53:21.214306 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:53:21.214377 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:53:21.214452 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:53:21.214517 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:53:21.523327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:53:34.804454 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:53:34.804546 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:53:34.804639 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:53:34.804722 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:53:34.804822 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:53:34.804897 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:53:34.804996 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:53:35.109399 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:53:49.091440 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:53:49.091565 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:53:49.091642 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:53:49.091730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:53:49.091801 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:53:49.091881 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:53:49.091950 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:53:49.401286 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:53:51.783105 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:53:51.783207 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:53:51.783298 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:53:51.783372 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:53:51.783455 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:53:51.783529 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:53:51.783611 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:53:52.099475 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:54:19.660024 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:54:19.660132 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:54:19.660212 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:54:19.660277 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:54:19.660349 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:54:19.660416 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:54:19.660491 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:54:19.972480 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:54:22.367461 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:54:22.367557 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:54:22.367623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:54:22.367690 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:54:22.367758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:54:22.367827 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:54:22.367892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:54:22.670049 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:54:34.929790 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:54:34.929868 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:54:34.929940 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:54:34.930002 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:54:34.930074 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:54:34.930135 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:54:34.930204 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:54:35.238046 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:54:50.258451 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:54:50.258531 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:54:50.258614 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:54:50.258674 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:54:50.258744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:54:50.258811 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:54:50.258874 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:54:50.564915 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:54:52.933491 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:54:52.933581 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:54:52.933644 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:54:52.933707 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:54:52.933785 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:54:52.933850 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:54:52.933916 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:54:53.239220 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:55:20.824348 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:55:20.824439 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:55:20.824543 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:55:20.824619 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:55:20.824691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:55:20.824776 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:55:20.824847 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:55:21.140467 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:55:23.501068 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:55:23.501158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:55:23.501229 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:55:23.501292 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:55:23.501356 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:55:23.501423 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:55:23.501489 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:55:23.807474 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:55:35.055317 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:55:35.055412 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:55:35.055494 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:55:35.055569 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:55:35.055649 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:55:35.055733 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:55:35.055810 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:55:35.357655 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:55:51.415042 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:55:51.415173 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:55:51.415249 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:55:51.415334 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:55:51.415408 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:55:51.415491 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:55:51.415564 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:55:51.716788 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:55:54.077450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:55:54.077548 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:55:54.077635 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:55:54.077715 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:55:54.077802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:55:54.077902 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:55:54.077979 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:55:54.386156 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:56:21.991995 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:56:21.992090 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:56:21.992159 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:56:21.992230 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:56:21.992305 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:56:21.992372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:56:21.992439 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:56:22.331598 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:56:24.652058 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:56:24.652158 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:56:24.652231 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:56:24.652288 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:56:24.652359 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:56:24.652436 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:56:24.652499 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:56:24.955907 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:56:35.175222 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:56:35.175309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:56:35.175381 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:56:35.175450 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:56:35.175514 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:56:35.175580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:56:35.175646 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:56:35.478859 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:56:52.590523 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:56:52.590601 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:56:52.590672 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:56:52.590749 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:56:52.590812 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:56:52.590874 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:56:52.590950 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:56:52.896102 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:56:55.229072 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:56:55.229167 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:56:55.229251 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:56:55.229326 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:56:55.229406 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:56:55.229476 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:56:55.229555 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:56:55.539435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:57:23.159357 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:57:23.159467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:57:23.159539 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:57:23.159611 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:57:23.159688 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:57:23.159773 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:57:23.159843 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:57:23.462428 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:57:25.812446 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:57:25.812536 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:57:25.812614 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:57:25.812676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:57:25.812750 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:57:25.812815 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:57:25.812878 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:57:26.122595 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:57:35.299001 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:57:35.299086 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:57:35.299150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:57:35.299227 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:57:35.299289 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:57:35.299355 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:57:35.299424 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:57:35.607890 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:57:53.722468 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:57:53.722548 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:57:53.722617 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:57:53.722676 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:57:53.722739 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:57:53.722801 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:57:53.722867 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:57:54.031338 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:57:56.382904 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:57:56.382999 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:57:56.383079 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:57:56.383144 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:57:56.383208 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:57:56.383274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:57:56.383335 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:57:56.688479 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:58:24.293464 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:58:24.293556 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:58:24.293628 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:58:24.293697 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:58:24.293767 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:58:24.293827 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:58:24.293893 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:58:24.599711 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:58:26.949232 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:58:26.949314 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:58:26.949383 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:58:26.949464 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:58:26.949525 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:58:26.949589 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:58:26.949651 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:58:27.260460 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:58:35.424013 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:58:35.424121 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:58:35.424216 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:58:35.424292 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:58:35.424370 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:58:35.424451 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:58:35.424528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:58:35.728929 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:58:54.860830 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:58:54.860952 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:58:54.861017 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:58:54.861083 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:58:54.861146 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:58:54.861211 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:58:54.861275 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:58:55.185983 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:58:57.525914 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:58:57.525996 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:58:57.526055 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:58:57.526121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:58:57.526185 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:58:57.526245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:58:57.526312 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:58:57.837843 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:59:25.445541 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:59:25.445640 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:59:25.445731 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:59:25.445826 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:59:25.445903 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:59:25.445977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:59:25.446057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:59:25.747120 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:59:28.098183 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:59:28.098293 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:59:28.098373 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:59:28.098445 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:59:28.098532 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:59:28.098611 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:59:28.098690 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:59:28.400344 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:59:35.551631 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:59:35.551758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:59:35.551841 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:59:35.551909 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:59:35.551984 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:59:35.552053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:59:35.552125 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:59:35.858965 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:59:56.016322 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:59:56.017442 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:59:56.017559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:59:56.017635 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:59:56.017723 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:59:56.017794 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:59:56.017863 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:59:56.324626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 14:59:58.660157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 14:59:58.660256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 14:59:58.660321 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 14:59:58.660383 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 14:59:58.660454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 14:59:58.660512 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 14:59:58.660577 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 14:59:58.972356 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:00:26.585755 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:00:26.585839 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:00:26.585907 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:00:26.585973 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:00:26.586037 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:00:26.586103 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:00:26.586165 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:00:26.887691 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:00:29.231080 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:00:29.231169 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:00:29.231249 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:00:29.231319 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:00:29.231386 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:00:29.231454 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:00:29.231514 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:00:29.535019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:00:35.678435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:00:35.678513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:00:35.678583 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:00:35.678649 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:00:35.678712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:00:35.678784 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:00:35.678852 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:00:35.981094 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:00:57.150151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:00:57.150241 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:00:57.150309 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:00:57.150371 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:00:57.150438 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:00:57.150502 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:00:57.150562 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:00:57.455431 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:00:59.793493 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:00:59.793586 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:00:59.793652 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:00:59.793723 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:00:59.794300 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:00:59.795014 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:00:59.795495 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:01:00.111217 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:01:27.712640 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:01:27.712738 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:01:27.712801 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:01:27.712864 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:01:27.712926 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:01:27.712992 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:01:27.713047 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:01:28.015944 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:01:30.370999 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:01:30.371094 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:01:30.371164 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:01:30.371224 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:01:30.371285 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:01:30.371346 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:01:30.371407 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:01:30.674098 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:01:35.804348 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:01:35.804428 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:01:35.804497 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:01:35.804564 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:01:35.804626 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:01:35.804688 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:01:35.804761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:01:36.110988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:01:58.278581 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:01:58.278682 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:01:58.278752 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:01:58.278822 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:01:58.278892 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:01:58.278955 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:01:58.279019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:01:58.581501 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:02:00.929643 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:02:00.929743 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:02:00.929808 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:02:00.929875 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:02:00.929938 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:02:00.930010 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:02:00.930073 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:02:01.231409 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:02:28.837437 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:02:28.837519 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:02:28.837588 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:02:28.837654 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:02:28.837723 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:02:28.837788 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:02:28.837851 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:02:29.150902 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:02:31.492216 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:02:31.492302 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:02:31.492371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:02:31.492437 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:02:31.492508 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:02:31.492574 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:02:31.492642 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:02:31.819701 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:02:35.932938 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:02:35.933071 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:02:35.933147 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:02:35.933233 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:02:35.933309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:02:35.933389 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:02:35.933468 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:02:36.240303 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:02:59.427221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:02:59.427343 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:02:59.427423 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:02:59.427504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:02:59.427586 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:02:59.427674 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:02:59.427755 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:02:59.730745 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:03:02.093018 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:03:02.093129 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:03:02.093213 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:03:02.093300 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:03:02.093395 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:03:02.093476 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:03:02.093554 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:03:02.412175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:03:29.992355 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:03:29.992478 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:03:29.992601 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:03:29.992688 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:03:29.992766 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:03:29.992867 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:03:29.992933 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:03:30.304832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:03:32.673162 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:03:32.673273 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:03:32.673350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:03:32.673432 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:03:32.673508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:03:32.673594 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:03:32.673671 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:03:32.978852 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:03:36.063459 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:03:36.063555 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:03:36.063632 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:03:36.063707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:03:36.063787 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:03:36.063858 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:03:36.063931 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:03:36.370860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:04:00.564856 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:04:00.564937 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:04:00.565031 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:04:00.565096 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:04:00.565159 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:04:00.565219 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:04:00.565277 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:04:00.864528 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:04:03.249184 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:04:03.249301 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:04:03.249377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:04:03.249463 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:04:03.249537 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:04:03.249618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:04:03.249689 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:04:03.551930 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:04:31.126449 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:04:31.126556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:04:31.126653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:04:31.126742 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:04:31.126818 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:04:31.126894 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:04:31.126981 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:04:31.435344 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:04:33.813619 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:04:33.813703 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:04:33.813775 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:04:33.813856 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:04:33.813921 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:04:33.815010 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:04:33.815276 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:04:34.127921 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:04:36.188035 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:04:36.188146 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:04:36.188233 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:04:36.188313 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:04:36.188396 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:04:36.188480 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:04:36.188556 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:04:36.505497 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:05:01.700237 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:05:01.700354 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:05:01.700432 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:05:01.700516 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:05:01.700593 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:05:01.700678 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:05:01.700766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:05:02.025909 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:05:04.403543 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:05:04.403669 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:05:04.403777 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:05:04.403851 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:05:04.403935 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:05:04.404002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:05:04.404075 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:05:04.706617 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:05:32.311942 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:05:32.312031 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:05:32.312110 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:05:32.312175 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:05:32.312236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:05:32.312302 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:05:32.312360 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:05:32.614292 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:05:34.968112 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:05:34.968212 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:05:34.968283 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:05:34.968351 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:05:34.968421 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:05:34.968486 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:05:34.968566 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:05:35.275113 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:05:36.318595 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:05:36.318701 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:05:36.318794 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:05:36.320240 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:05:36.320767 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:05:36.320955 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:05:36.321122 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:05:36.631820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:06:02.873066 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:06:02.873179 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:06:02.873241 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:06:02.873313 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:06:02.873379 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:06:02.873446 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:06:02.873511 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:06:03.193183 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:06:05.537961 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:06:05.538048 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:06:05.538115 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:06:05.538182 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:06:05.538248 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:06:05.538303 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:06:05.538366 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:06:05.849165 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:06:33.462135 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:06:33.462257 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:06:33.462342 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:06:33.462419 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:06:33.462505 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:06:33.462579 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:06:33.462656 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:06:33.765573 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:06:36.111048 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:06:36.111170 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:06:36.111251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:06:36.111338 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:06:36.111419 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:06:36.111499 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:06:36.111578 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:06:36.414267 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:06:36.672210 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:06:36.672308 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:06:36.672397 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:06:36.672488 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:06:36.672573 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:06:36.672650 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:06:36.672753 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:06:36.976558 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:07:04.033546 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:07:04.033678 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:07:04.033770 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:07:04.033880 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:07:04.033959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:07:04.034041 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:07:04.034128 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:07:04.347529 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:07:06.674166 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:07:06.674287 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:07:06.674366 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:07:06.674459 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:07:06.674534 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:07:06.674610 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:07:06.674692 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:07:06.980647 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:07:34.607224 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:07:34.607307 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:07:34.607389 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:07:34.607460 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:07:34.607524 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:07:34.607602 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:07:34.607677 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:07:34.919486 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:07:36.569906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:07:36.569992 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:07:36.570056 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:07:36.570121 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:07:36.570185 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:07:36.570251 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:07:36.570308 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:07:36.870751 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:07:37.243660 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:07:37.243743 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:07:37.243807 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:07:37.243884 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:07:37.243955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:07:37.244016 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:07:37.244081 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:07:37.553910 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:08:05.184972 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:08:05.185053 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:08:05.185124 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:08:05.185193 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:08:05.185265 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:08:05.185328 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:08:05.185393 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:08:05.494090 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:08:07.818024 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:08:07.818128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:08:07.818196 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:08:07.818275 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:08:07.818340 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:08:07.818400 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:08:07.819060 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:08:08.122967 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:08:35.753747 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:08:35.753865 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:08:35.753931 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:08:35.754000 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:08:35.754068 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:08:35.754131 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:08:35.754200 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:08:36.054382 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:08:36.699241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:08:36.699325 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:08:36.699398 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:08:36.699465 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:08:36.699537 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:08:36.699598 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:08:36.699668 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:08:37.000752 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:08:38.385754 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:08:38.385837 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:08:38.385906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:08:38.385969 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:08:38.386040 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:08:38.386104 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:08:38.386171 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:08:38.700322 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:09:06.316683 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:09:06.316770 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:09:06.316846 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:09:06.316908 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:09:06.316969 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:09:06.317031 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:09:06.317095 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:09:06.617879 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:09:08.962429 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:09:08.962513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:09:08.962574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:09:08.962642 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:09:08.962704 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:09:08.962772 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:09:08.962832 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:09:09.270828 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:09:36.828984 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:09:36.829086 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:09:36.829179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:09:36.829273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:09:36.829350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:09:36.829437 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:09:36.829517 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:09:37.131354 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:09:37.383516 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:09:37.383605 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:09:37.383687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:09:37.383770 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:09:37.383845 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:09:37.383924 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:09:37.384007 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:09:37.678895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:09:39.528099 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:09:39.528199 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:09:39.528272 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:09:39.528346 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:09:39.528422 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:09:39.528489 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:09:39.528553 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:09:39.832815 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:10:07.384870 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:10:07.384990 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:10:07.385079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:10:07.385157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:10:07.385237 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:10:07.385314 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:10:07.385395 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:10:07.687028 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:10:10.103329 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:10:10.103424 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:10:10.103501 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:10:10.103569 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:10:10.103655 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:10:10.103739 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:10:10.103818 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:10:10.405540 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:10:36.960833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:10:36.960947 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:10:36.961030 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:10:36.961106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:10:36.961183 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:10:36.961274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:10:36.961347 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:10:37.275810 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:10:37.946673 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:10:37.946783 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:10:37.946860 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:10:37.946935 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:10:37.947007 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:10:37.947078 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:10:37.947146 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:10:38.257567 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:10:40.659417 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:10:40.659502 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:10:40.659579 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:10:40.659651 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:10:40.659734 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:10:40.659804 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:10:40.659872 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:10:40.969649 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:11:08.527483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:11:08.527573 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:11:08.527652 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:11:08.527725 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:11:08.527789 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:11:08.527859 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:11:08.527921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:11:08.836039 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:11:11.228649 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:11:11.228740 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:11:11.228806 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:11:11.228891 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:11:11.228955 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:11:11.229020 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:11:11.229082 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:11:11.542631 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:11:37.088323 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:11:37.088399 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:11:37.088467 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:11:37.088533 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:11:37.088591 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:11:37.088656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:11:37.088727 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:11:37.401573 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:11:39.109923 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:11:39.110698 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:11:39.110813 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:11:39.110896 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:11:39.110980 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:11:39.111060 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:11:39.111124 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:11:39.441004 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:11:41.824606 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:11:41.824731 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:11:41.824806 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:11:41.824873 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:11:41.824942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:11:41.825015 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:11:41.825080 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:11:42.150777 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:12:09.700753 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:12:09.700838 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:12:09.700904 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:12:09.700967 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:12:09.701028 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:12:09.701088 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:12:09.701151 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:12:10.016644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:12:12.417747 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:12:12.417836 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:12:12.417915 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:12:12.417982 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:12:12.418056 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:12:12.418119 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:12:12.418186 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:12:12.720378 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:12:37.215800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:12:37.215887 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:12:37.215956 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:12:37.216028 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:12:37.216089 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:12:37.216164 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:12:37.216230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:12:37.519932 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:12:40.292475 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:12:40.292564 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:12:40.292643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:12:40.292713 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:12:40.292784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:12:40.292844 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:12:40.292912 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:12:40.597741 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:12:42.983425 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:12:42.984349 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:12:42.984690 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:12:42.985691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:12:42.986308 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:12:42.986815 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:12:42.986912 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:12:43.287436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:13:10.861129 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:13:10.861214 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:13:10.861281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:13:10.861349 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:13:10.861423 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:13:10.861490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:13:10.861557 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:13:11.170023 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:13:13.549498 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:13:13.549614 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:13:13.549682 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:13:13.549752 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:13:13.549815 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:13:13.549878 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:13:13.549945 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:13:13.855121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:13:37.348962 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:13:37.349044 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:13:37.349109 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:13:37.349184 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:13:37.349244 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:13:37.349313 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:13:37.349380 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:13:37.657280 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:13:41.430899 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:13:41.430996 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:13:41.431077 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:13:41.431160 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:13:41.431249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:13:41.431319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:13:41.431400 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:13:41.739627 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:13:44.118349 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:13:44.118445 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:13:44.118520 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:13:44.118592 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:13:44.118670 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:13:44.118749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:13:44.118820 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:13:44.433225 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:14:12.015183 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:14:12.015300 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:14:12.015379 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:14:12.015455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:14:12.015539 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:14:12.015620 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:14:12.015697 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:14:12.344207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:14:14.698059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:14:14.698172 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:14:14.698244 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:14:14.698318 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:14:14.698396 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:14:14.698465 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:14:14.698528 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:14:15.006104 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:14:37.477662 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:14:37.477753 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:14:37.477820 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:14:37.477884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:14:37.477951 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:14:37.478013 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:14:37.478075 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:14:37.781416 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:14:42.603362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:14:42.603475 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:14:42.603556 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:14:42.603630 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:14:42.603710 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:14:42.603788 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:14:42.603882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:14:42.907497 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:14:45.270089 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:14:45.270186 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:14:45.270264 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:14:45.270337 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:14:45.270424 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:14:45.270503 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:14:45.270579 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:14:45.574093 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:15:13.169822 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:15:13.169918 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:15:13.169995 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:15:13.170093 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:15:13.170175 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:15:13.170250 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:15:13.170336 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:15:13.470878 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:15:15.834597 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:15:15.834694 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:15:15.834791 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:15:15.834882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:15:15.834964 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:15:15.835031 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:15:15.835113 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:15:16.141649 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:15:37.601327 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:15:37.601405 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:15:37.601472 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:15:37.601537 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:15:37.601606 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:15:37.601671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:15:37.601744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:15:37.904142 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:15:43.727287 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:15:43.727391 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:15:43.727455 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:15:43.727524 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:15:43.727585 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:15:43.727655 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:15:43.727721 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:15:44.045355 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:15:46.396437 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:15:46.396548 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:15:46.396615 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:15:46.396680 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:15:46.396754 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:15:46.396819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:15:46.396885 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:15:46.698402 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:16:14.304425 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:16:14.304504 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:16:14.304584 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:16:14.304645 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:16:14.304705 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:16:14.304776 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:16:14.304855 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:16:14.616197 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:16:16.958814 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:16:16.958911 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:16:16.958987 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:16:16.959051 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:16:16.959109 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:16:16.959179 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:16:16.959235 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:16:17.266073 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:16:37.751673 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:16:37.751768 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:16:37.751840 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:16:37.751910 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:16:37.751989 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:16:37.752050 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:16:37.752110 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:16:38.071664 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:16:44.876159 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:16:44.876243 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:16:44.876313 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:16:44.876373 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:16:44.876435 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:16:44.876511 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:16:44.876570 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:16:45.188948 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:16:47.528808 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:16:47.528906 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:16:47.528971 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:16:47.529038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:16:47.529100 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:16:47.529168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:16:47.529237 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:16:47.839855 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:17:15.459128 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:17:15.459215 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:17:15.459282 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:17:15.459352 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:17:15.459417 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:17:15.459476 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:17:15.459534 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:17:15.763299 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:17:18.099324 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:17:18.099403 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:17:18.099470 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:17:18.099542 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:17:18.099603 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:17:18.099667 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:17:18.099753 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:17:18.401425 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:17:37.877163 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:17:37.877248 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:17:37.877320 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:17:37.877387 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:17:37.877450 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:17:37.877521 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:17:37.877586 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:17:38.183192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:17:46.026215 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:17:46.026300 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:17:46.026367 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:17:46.026433 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:17:46.026496 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:17:46.026556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:17:46.026620 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:17:46.328854 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:17:48.668355 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:17:48.668457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:17:48.668538 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:17:48.668629 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:17:48.668710 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:17:48.668788 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:17:48.668868 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:17:48.969371 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:18:16.609796 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:18:16.609889 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:18:16.609968 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:18:16.610029 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:18:16.610104 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:18:16.610176 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:18:16.610246 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:18:16.914635 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:18:19.237794 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:18:19.237887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:18:19.237966 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:18:19.238037 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:18:19.238098 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:18:19.238164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:18:19.238236 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:18:19.541754 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:18:38.007167 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:18:38.007263 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:18:38.007393 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:18:38.007486 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:18:38.007588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:18:38.007692 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:18:38.007797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:18:38.317820 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:18:47.171600 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:18:47.171684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:18:47.171766 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:18:47.171837 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:18:47.171904 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:18:47.171978 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:18:47.172037 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:18:47.480360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:18:49.804846 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:18:49.804945 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:18:49.805028 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:18:49.805101 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:18:49.805178 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:18:49.805252 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:18:49.805331 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:18:50.118444 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:19:17.748679 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:19:17.748802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:19:17.748873 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:19:17.748949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:19:17.749019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:19:17.749091 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:19:17.749168 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:19:18.062436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:19:20.377299 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:19:20.377384 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:19:20.377459 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:19:20.377530 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:19:20.377591 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:19:20.377656 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:19:20.377723 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:19:20.681710 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:19:38.130707 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:19:38.130807 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:19:38.130893 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:19:38.130966 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:19:38.131044 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:19:38.131114 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:19:38.131189 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:19:38.438762 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:19:48.324699 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:19:48.324855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:19:48.324930 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:19:48.325025 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:19:48.325111 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:19:48.325197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:19:48.325269 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:19:48.623372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:19:50.939625 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:19:50.939726 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:19:50.939804 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:19:50.939876 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:19:50.939946 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:19:50.940011 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:19:50.940080 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:19:51.252323 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:20:18.885512 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:20:18.885628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:20:18.885710 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:20:18.885812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:20:18.885895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:20:18.885976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:20:18.886056 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:20:19.194840 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:20:21.516991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:20:21.517089 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:20:21.517173 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:20:21.517249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:20:21.517316 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:20:21.517383 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:20:21.517456 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:20:21.831752 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:20:38.258737 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:20:38.258823 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:20:38.258898 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:20:38.258961 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:20:38.259026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:20:38.259090 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:20:38.259152 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:20:38.580563 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:20:49.460426 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:20:49.460555 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:20:49.460638 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:20:49.460727 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:20:49.460802 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:20:49.460877 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:20:49.460963 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:20:49.763502 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:20:52.113653 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:20:52.114172 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:20:52.114822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:20:52.114928 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:20:52.115027 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:20:52.115106 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:20:52.115188 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:20:52.438367 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:21:20.031190 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:21:20.031291 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:21:20.031376 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:21:20.031459 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:21:20.031546 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:21:20.031631 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:21:20.031707 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:21:20.335323 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:21:22.698385 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:21:22.698495 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:21:22.698572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:21:22.698657 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:21:22.698743 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:21:22.698857 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:21:22.698938 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:21:22.999996 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:21:38.386581 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:21:38.386673 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:21:38.386753 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:21:38.386827 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:21:38.386907 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:21:38.386977 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:21:38.387039 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:21:38.686334 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:21:50.595695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:21:50.595807 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:21:50.595868 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:21:50.595935 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:21:50.595999 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:21:50.596062 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:21:50.596122 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:21:50.897355 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:21:53.256291 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:21:53.256379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:21:53.256442 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:21:53.256505 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:21:53.256571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:21:53.256638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:21:53.256700 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:21:53.562335 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:22:21.164748 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:22:21.164868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:22:21.164952 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:22:21.165045 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:22:21.165127 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:22:21.165228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:22:21.165318 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:22:21.479221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:22:23.823185 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:22:23.823278 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:22:23.823347 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:22:23.823432 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:22:23.823504 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:22:23.823572 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:22:23.823638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:22:24.133471 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:22:38.514183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:22:38.514263 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:22:38.514329 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:22:38.514403 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:22:38.514463 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:22:38.514526 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:22:38.514584 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:22:38.816984 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:22:51.736508 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:22:51.736613 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:22:51.736671 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:22:51.736743 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:22:51.736803 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:22:51.736864 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:22:51.736927 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:22:52.078300 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:22:54.414848 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:22:54.414952 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:22:54.415018 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:22:54.415083 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:22:54.415145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:22:54.415206 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:22:54.415262 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:22:54.717258 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:23:22.350684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:23:22.350785 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:23:22.350852 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:23:22.350918 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:23:22.350980 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:23:22.351044 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:23:22.351104 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:23:22.656121 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:23:24.979145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:23:24.979247 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:23:24.979335 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:23:24.979428 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:23:24.979503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:23:24.979586 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:23:24.979660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:23:25.294284 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:23:38.640595 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:23:38.640681 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:23:38.640767 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:23:38.640840 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:23:38.640916 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:23:38.640986 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:23:38.641060 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:23:38.942817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:23:52.916764 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:23:52.916850 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:23:52.916918 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:23:52.916979 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:23:52.917041 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:23:52.917105 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:23:52.917169 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:23:53.225203 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:23:55.556061 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:23:55.556143 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:23:55.556227 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:23:55.556293 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:23:55.556352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:23:55.556420 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:23:55.556483 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:23:55.857460 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:24:23.489744 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:24:23.489829 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:24:23.489908 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:24:23.489972 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:24:23.490036 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:24:23.490098 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:24:23.490166 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:24:23.791876 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:24:26.112099 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:24:26.112181 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:24:26.112248 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:24:26.112332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:24:26.112393 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:24:26.112460 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:24:26.112528 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:24:26.417891 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:24:38.767756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:24:38.767836 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:24:38.767919 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:24:38.767980 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:24:38.768046 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:24:38.768109 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:24:38.768174 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:24:39.079481 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:24:54.055707 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:24:54.055791 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:24:54.055856 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:24:54.055921 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:24:54.055989 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:24:54.056052 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:24:54.056113 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:24:54.369193 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:24:56.680510 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:24:56.680601 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:24:56.680662 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:24:56.680730 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:24:56.680797 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:24:56.680860 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:24:56.680925 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:24:56.991638 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:25:24.633469 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:25:24.633562 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:25:24.633643 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:25:24.633700 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:25:24.633766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:25:24.633824 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:25:24.633889 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:25:24.935145 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:25:27.256013 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:25:27.256100 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:25:27.256167 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:25:27.256241 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:25:27.256301 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:25:27.256357 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:25:27.256418 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:25:27.559249 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:25:38.893604 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:25:38.893683 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:25:38.893751 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:25:38.893815 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:25:38.893878 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:25:38.893944 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:25:38.894004 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:25:39.214037 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:25:55.209451 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:25:55.209533 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:25:55.209600 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:25:55.209660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:25:55.209730 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:25:55.209792 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:25:55.209862 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:25:55.518240 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:25:57.818629 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:25:57.818767 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:25:57.818861 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:25:57.818947 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:25:57.819041 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:25:57.819122 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:25:57.819196 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:25:58.124518 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:26:25.777270 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:26:25.777399 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:26:25.777478 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:26:25.777548 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:26:25.777624 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:26:25.777697 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:26:25.777779 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:26:26.077284 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:26:28.384207 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:26:28.384319 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:26:28.384394 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:26:28.384460 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:26:28.384520 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:26:28.384582 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:26:28.384652 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:26:28.686551 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:26:39.024756 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:26:39.024850 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:26:39.024917 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:26:39.024983 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:26:39.025052 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:26:39.025121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:26:39.025184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:26:39.331136 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:26:56.343232 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:26:56.343313 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:26:56.343402 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:26:56.343460 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:26:56.343524 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:26:56.343596 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:26:56.343659 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:26:56.661321 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:26:58.951220 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:26:58.951328 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:26:58.951397 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:26:58.951460 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:26:58.951533 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:26:58.951593 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:26:58.951658 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:26:59.276584 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:27:26.940707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:27:26.940811 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:27:26.940879 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:27:26.940945 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:27:26.941009 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:27:26.941073 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:27:26.941140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:27:27.256643 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:27:29.534559 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:27:29.534647 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:27:29.534729 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:27:29.534797 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:27:29.534862 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:27:29.534930 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:27:29.534993 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:27:29.847276 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:27:39.158100 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:27:39.158215 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:27:39.158288 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:27:39.158353 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:27:39.158429 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:27:39.158500 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:27:39.158575 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:27:39.469864 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:27:57.517700 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:27:57.517818 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:27:57.517885 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:27:57.517951 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:27:57.518016 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:27:57.518075 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:27:57.518143 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:27:57.818911 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:28:00.126749 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:28:00.126834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:28:00.126908 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:28:00.126974 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:28:00.127040 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:28:00.127106 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:28:00.127175 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:28:00.432272 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:28:28.074743 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:28:28.074821 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:28:28.074884 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:28:28.074959 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:28:28.075028 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:28:28.075086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:28:28.075152 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:28:28.377993 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:28:30.694016 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:28:30.694097 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:28:30.694172 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:28:30.694229 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:28:30.694290 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:28:30.694353 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:28:30.694421 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:28:30.995020 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:28:39.281440 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:28:39.281516 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:28:39.281588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:28:39.281656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:28:39.281727 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:28:39.281790 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:28:39.281854 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:28:39.590352 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:28:58.644866 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:28:58.644956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:28:58.645069 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:28:58.645165 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:28:58.645228 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:28:58.645311 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:28:58.645381 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:28:58.957680 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:29:01.250756 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:29:01.250862 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:29:01.250940 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:29:01.251003 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:29:01.251064 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:29:01.251123 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:29:01.251183 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:29:01.553560 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:29:29.237547 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:29:29.237625 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:29:29.237702 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:29:29.237774 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:29:29.237840 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:29:29.237906 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:29:29.237977 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:29:29.546432 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:29:31.817015 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:29:31.817102 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:29:31.817177 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:29:31.817245 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:29:31.817308 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:29:31.817372 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:29:31.817435 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:29:32.127363 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:29:39.404247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:29:39.404333 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:29:39.404402 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:29:39.404471 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:29:39.404532 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:29:39.404598 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:29:39.404658 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:29:39.712152 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:29:59.803466 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:29:59.803551 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:29:59.803626 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:29:59.803685 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:29:59.803756 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:29:59.803814 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:29:59.803875 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:30:00.124098 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:30:02.394374 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:30:02.395085 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:30:02.395624 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:30:02.396301 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:30:02.396404 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:30:02.396485 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:30:02.396560 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:30:02.712566 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:30:30.390628 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:30:30.390750 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:30:30.390860 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:30:30.390952 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:30:30.391036 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:30:30.391120 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:30:30.391196 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:30:30.694043 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:30:32.988960 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:30:32.989063 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:30:32.989151 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:30:32.989229 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:30:32.989310 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:30:32.989387 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:30:32.989470 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:30:33.292837 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:30:39.527213 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:30:39.527302 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:30:39.527373 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:30:39.527447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:30:39.527520 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:30:39.527581 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:30:39.527649 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:30:39.847801 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:31:00.956206 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:31:00.956304 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:31:00.956366 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:31:00.956431 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:31:00.956498 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:31:00.956558 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:31:00.956619 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:31:01.268364 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:31:03.550835 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:31:03.550913 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:31:03.550992 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:31:03.551063 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:31:03.551126 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:31:03.551190 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:31:03.551253 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:31:03.857036 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:31:31.530456 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:31:31.530637 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:31:31.530750 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:31:31.530843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:31:31.530922 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:31:31.531031 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:31:31.531115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:31:31.836079 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:31:34.117427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:31:34.117508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:31:34.117578 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:31:34.117644 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:31:34.117721 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:31:34.117792 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:31:34.117864 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:31:34.441773 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:31:39.647247 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:31:39.647324 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:31:39.647390 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:31:39.647469 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:31:39.647538 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:31:39.647599 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:31:39.647668 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:31:39.953283 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:32:02.106152 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:32:02.106236 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:32:02.106299 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:32:02.106361 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:32:02.106433 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:32:02.106495 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:32:02.106561 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:32:02.407236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:32:04.700923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:32:04.701006 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:32:04.701075 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:32:04.701142 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:32:04.701210 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:32:04.701274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:32:04.701338 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:32:05.012971 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:32:32.664906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:32:32.664998 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:32:32.665061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:32:32.665131 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:32:32.665197 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:32:32.665260 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:32:32.665325 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:32:32.972847 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:32:35.282910 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:32:35.283491 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:32:35.283584 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:32:35.283658 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:32:35.283736 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:32:35.283812 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:32:35.283887 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:32:35.584938 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:32:39.768355 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:32:39.768446 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:32:39.768508 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:32:39.768580 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:32:39.768640 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:32:39.768706 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:32:39.768774 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:32:40.086201 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:33:03.230884 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:33:03.231012 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:33:03.231074 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:33:03.231143 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:33:03.231205 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:33:03.231270 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:33:03.231327 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:33:03.533920 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:33:05.845358 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:33:05.845443 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:33:05.845521 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:33:05.845580 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:33:05.845644 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:33:05.845705 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:33:05.845768 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:33:06.151760 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:33:33.789549 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:33:33.789632 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:33:33.789706 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:33:33.789781 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:33:33.789855 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:33:33.789918 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:33:33.789981 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:33:34.105084 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:33:36.417079 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:33:36.417179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:33:36.417246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:33:36.417311 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:33:36.417370 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:33:36.417435 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:33:36.417493 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:33:36.722899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:33:39.891574 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:33:39.891660 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:33:39.891741 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:33:39.891802 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:33:39.891868 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:33:39.891939 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:33:39.892003 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:33:40.200903 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:34:04.372013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:34:04.372105 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:34:04.372176 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:34:04.372238 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:34:04.372301 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:34:04.372369 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:34:04.372432 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:34:04.673611 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:34:06.980572 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:34:06.980662 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:34:06.980740 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:34:06.980808 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:34:06.980871 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:34:06.980939 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:34:06.981004 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:34:07.287769 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:34:34.940895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:34:34.940987 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:34:34.941058 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:34:34.941125 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:34:34.941181 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:34:34.941240 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:34:34.941301 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:34:35.249054 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:34:37.549881 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:34:37.549969 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:34:37.550035 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:34:37.550101 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:34:37.550163 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:34:37.550234 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:34:37.550295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:34:37.855060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:34:40.017792 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:34:40.018344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:34:40.018910 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:34:40.019304 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:34:40.019624 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:34:40.020096 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:34:40.020203 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:34:40.334634 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:35:05.514977 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:35:05.515098 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:35:05.515176 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:35:05.515265 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:35:05.515346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:35:05.515431 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:35:05.515507 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:35:05.820435 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:35:08.127621 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:35:08.127728 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:35:08.127804 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:35:08.127873 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:35:08.127943 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:35:08.128026 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:35:08.128097 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:35:08.431310 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:35:36.083356 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:35:36.083459 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:35:36.083533 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:35:36.083619 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:35:36.083697 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:35:36.083780 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:35:36.083860 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:35:36.392381 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:35:38.691967 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:35:38.692103 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:35:38.692190 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:35:38.692274 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:35:38.692350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:35:38.692430 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:35:38.692503 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:35:38.996852 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:35:40.141998 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:35:40.142096 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:35:40.142168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:35:40.142247 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:35:40.142320 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:35:40.142401 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:35:40.142475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:35:40.446453 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:36:06.655693 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:36:06.655998 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:36:06.656641 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:36:06.656741 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:36:06.656817 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:36:06.656932 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:36:06.657016 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:36:06.961744 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:36:09.271242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:36:09.271349 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:36:09.271437 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:36:09.271518 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:36:09.271603 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:36:09.271682 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:36:09.271777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:36:09.576316 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:36:37.233312 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:36:37.233412 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:36:37.233488 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:36:37.233564 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:36:37.233638 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:36:37.233709 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:36:37.233790 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:36:37.537439 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:36:39.835985 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:36:39.836065 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:36:39.836141 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:36:39.836211 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:36:39.836273 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:36:39.836336 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:36:39.836394 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:36:40.149115 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:36:40.421625 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:36:40.421711 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:36:40.421786 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:36:40.421870 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:36:40.421946 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:36:40.422010 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:36:40.422073 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:36:40.729487 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:37:07.794052 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:37:07.794162 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:37:07.794230 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:37:07.794309 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:37:07.794374 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:37:07.794447 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:37:07.794504 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:37:08.096493 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:37:10.424692 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:37:10.424800 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:37:10.424865 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:37:10.424929 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:37:10.424990 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:37:10.425860 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:37:10.426321 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:37:10.726336 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:37:38.360968 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:37:38.361061 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:37:38.361130 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:37:38.361196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:37:38.361259 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:37:38.361324 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:37:38.361381 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:37:38.668779 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:37:40.385858 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:37:40.385935 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:37:40.386001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:37:40.386066 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:37:40.386134 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:37:40.386191 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:37:40.386264 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:37:40.700614 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:37:40.988976 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:37:40.989062 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:37:40.989121 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:37:40.989188 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:37:40.989256 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:37:40.989317 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:37:40.989379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:37:41.305575 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:38:08.927497 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:38:08.927619 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:38:08.927687 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:38:08.927759 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:38:08.927825 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:38:08.927886 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:38:08.927947 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:38:09.261076 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:38:11.567733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:38:11.567851 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:38:11.567918 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:38:11.567978 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:38:11.568045 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:38:11.568110 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:38:11.568173 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:38:11.884317 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:38:39.520040 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:38:39.520129 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:38:39.520219 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:38:39.520293 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:38:39.520367 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:38:39.520445 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:38:39.520522 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:38:39.823593 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:38:40.518644 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:38:40.518763 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:38:40.518845 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:38:40.518925 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:38:40.519014 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:38:40.519102 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:38:40.519180 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:38:40.819641 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:38:42.162820 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:38:42.162921 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:38:42.163003 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:38:42.163082 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:38:42.163154 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:38:42.163237 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:38:42.163314 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:38:42.465617 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:39:10.091977 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:39:10.092105 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:39:10.092189 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:39:10.092283 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:39:10.092368 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:39:10.092454 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:39:10.092541 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:39:10.402345 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:39:12.724266 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:39:12.724380 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:39:12.724467 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:39:12.724544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:39:12.724613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:39:12.724691 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:39:12.724769 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:39:13.029461 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:39:40.643884 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:39:40.643987 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:39:40.644073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:39:40.644157 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:39:40.644232 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:39:40.644312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:39:40.644401 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:39:40.951531 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:39:41.217595 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:39:41.217701 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:39:41.217783 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:39:41.217863 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:39:41.217938 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:39:41.218011 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:39:41.218088 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:39:41.520524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:39:43.291686 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:39:43.291784 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:39:43.291855 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:39:43.291935 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:39:43.292011 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:39:43.292086 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:39:43.292156 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:39:43.603850 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:40:11.219464 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:40:11.219613 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:40:11.219765 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:40:11.219887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:40:11.219992 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:40:11.220099 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:40:11.220225 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:40:11.523129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:40:13.864548 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:40:13.864653 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:40:13.864761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:40:13.864842 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:40:13.864935 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:40:13.865021 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:40:13.865102 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:40:14.178836 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:40:40.770054 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:40:40.770154 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:40:40.770224 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:40:40.770316 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:40:40.770384 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:40:40.770473 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:40:40.770540 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:40:41.075755 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:40:41.782945 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:40:41.783094 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:40:41.783221 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:40:41.783305 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:40:41.783383 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:40:41.783474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:40:41.783576 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:40:42.105854 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:40:44.437491 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:40:44.437583 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:40:44.437659 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:40:44.437743 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:40:44.437821 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:40:44.437906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:40:44.437990 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:40:44.748995 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:41:12.399819 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:41:12.399926 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:41:12.400003 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:41:12.400073 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:41:12.400140 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:41:12.400205 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:41:12.400284 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:41:12.712659 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:41:15.021018 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:41:15.021105 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:41:15.021165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:41:15.021237 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:41:15.021304 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:41:15.021370 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:41:15.021436 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:41:15.332118 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:41:40.890988 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:41:40.891071 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:41:40.891147 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:41:40.891210 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:41:40.891281 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:41:40.891350 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:41:40.891412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:41:41.207165 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:41:43.004347 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:41:43.004434 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:41:43.004503 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:41:43.004570 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:41:43.004635 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:41:43.004700 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:41:43.004779 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:41:43.317669 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:41:45.600492 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:41:45.600586 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:41:45.600678 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:41:45.600788 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:41:45.600869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:41:45.600955 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:41:45.601037 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:41:45.906925 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:42:13.592664 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:42:13.592780 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:42:13.592862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:42:13.592951 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:42:13.593046 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:42:13.593120 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:42:13.593197 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:42:13.897755 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:42:16.167332 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:42:16.167421 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:42:16.167502 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:42:16.167583 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:42:16.167658 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:42:16.167741 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:42:16.167837 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:42:16.465452 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:42:41.014033 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:42:41.014129 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:42:41.014204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:42:41.014269 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:42:41.014330 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:42:41.014422 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:42:41.014495 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:42:41.323992 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:42:44.155862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:42:44.155948 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:42:44.156019 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:42:44.156086 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:42:44.156152 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:42:44.156219 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:42:44.156284 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:42:44.468689 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:42:46.726208 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:42:46.726291 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:42:46.726354 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:42:46.726417 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:42:46.726475 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:42:46.726542 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:42:46.726606 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:42:47.029158 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:43:14.732485 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:43:14.732574 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:43:14.732656 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:43:14.732725 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:43:14.732798 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:43:14.732868 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:43:14.732921 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:43:15.036268 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:43:17.290043 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:43:17.290127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:43:17.290196 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:43:17.290263 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:43:17.290332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:43:17.290392 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:43:17.290457 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:43:17.593855 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:43:41.137681 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:43:41.137779 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:43:41.137846 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:43:41.137908 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:43:41.137976 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:43:41.138039 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:43:41.138104 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:43:41.444643 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:43:45.292294 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:43:45.292407 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:43:45.292479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:43:45.292541 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:43:45.292600 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:43:45.292656 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:43:45.292715 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:43:45.599958 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:43:47.869978 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:43:47.870521 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:43:47.871273 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:43:47.871406 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:43:47.871522 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:43:47.871619 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:43:47.871707 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:43:48.182075 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:44:15.861161 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:44:15.861258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:44:15.861347 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:44:15.861421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:44:15.861514 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:44:15.861591 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:44:15.861673 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:44:16.168131 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:44:18.441870 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:44:18.441991 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:44:18.442070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:44:18.442144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:44:18.442231 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:44:18.442306 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:44:18.442386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:44:18.747662 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:44:41.262597 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:44:41.262708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:44:41.262791 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:44:41.262878 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:44:41.262946 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:44:41.263027 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:44:41.263102 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:44:41.562399 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:44:46.429345 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:44:46.429436 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:44:46.429510 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:44:46.429580 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:44:46.429657 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:44:46.429730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:44:46.429807 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:44:46.736969 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:44:49.008605 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:44:49.008711 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:44:49.008791 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:44:49.008876 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:44:49.008954 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:44:49.009038 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:44:49.009116 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:44:49.323601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:45:16.997317 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:45:16.997411 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:45:16.997496 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:45:16.997588 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:45:16.997658 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:45:16.997747 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:45:16.997837 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:45:17.309555 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:45:19.584601 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:45:19.584702 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:45:19.584776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:45:19.584842 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:45:19.584906 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:45:19.584971 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:45:19.585034 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:45:19.893001 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:45:41.385339 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:45:41.385418 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:45:41.385484 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:45:41.385551 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:45:41.385614 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:45:41.385674 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:45:41.385739 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:45:41.692773 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:45:47.575263 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:45:47.575345 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:45:47.575416 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:45:47.575486 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:45:47.575557 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:45:47.575613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:45:47.575681 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:45:47.890303 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:45:50.167144 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:45:50.167227 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:45:50.167311 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:45:50.167376 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:45:50.167451 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:45:50.167510 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:45:50.167572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:45:50.477974 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:46:18.152481 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:46:18.152564 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:46:18.152642 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:46:18.152704 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:46:18.152780 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:46:18.152842 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:46:18.152906 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:46:18.461742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:46:20.737185 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:46:20.737368 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:46:20.737460 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:46:20.737544 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:46:20.737637 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:46:20.737723 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:46:20.737834 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:46:21.036599 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:46:41.510959 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:46:41.511053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:46:41.511136 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:46:41.511216 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:46:41.511297 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:46:41.511376 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:46:41.511454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:46:41.845578 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:46:48.720098 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:46:48.720193 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:46:48.720269 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:46:48.720333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:46:48.720405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:46:48.720472 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:46:48.720537 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:46:49.027055 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:46:51.296782 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:46:51.296884 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:46:51.296962 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:46:51.297049 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:46:51.297126 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:46:51.297203 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:46:51.297276 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:46:51.599881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:47:19.288908 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:47:19.289002 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:47:19.289087 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:47:19.289182 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:47:19.289258 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:47:19.289332 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:47:19.289409 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:47:19.595176 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:47:21.866944 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:47:21.867046 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:47:21.867124 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:47:21.867202 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:47:21.867282 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:47:21.867368 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:47:21.867436 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:47:22.186001 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:47:41.637272 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:47:41.637377 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:47:41.637450 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:47:41.637596 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:47:41.637671 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:47:41.637749 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:47:41.637815 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:47:41.946305 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:47:49.855960 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:47:49.856044 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:47:49.856129 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:47:49.856199 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:47:49.856271 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:47:49.856335 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:47:49.856406 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:47:50.172580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:47:52.449897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:47:52.450029 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:47:52.450109 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:47:52.450189 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:47:52.450273 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:47:52.450342 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:47:52.450442 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:47:52.754009 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:48:20.435613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:48:20.435722 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:48:20.435829 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:48:20.435911 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:48:20.435988 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:48:20.436069 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:48:20.436144 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:48:20.744134 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:48:23.012850 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:48:23.012957 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:48:23.013038 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:48:23.013118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:48:23.013191 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:48:23.013263 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:48:23.013343 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:48:23.323975 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:48:41.774942 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:48:41.775043 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:48:41.775133 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:48:41.775225 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:48:41.775307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:48:41.775383 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:48:41.775464 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:48:42.098129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:48:51.002024 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:48:51.002117 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:48:51.002210 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:48:51.002290 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:48:51.002372 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:48:51.002444 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:48:51.002528 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:48:51.301738 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:48:53.584648 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:48:53.584773 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:48:53.584855 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:48:53.584941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:48:53.585026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:48:53.585105 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:48:53.585188 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:48:53.883372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:49:21.566302 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:49:21.566391 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:49:21.566469 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:49:21.566542 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:49:21.566607 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:49:21.566668 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:49:21.566754 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:49:21.880388 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:49:24.158710 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:49:24.158803 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:49:24.158870 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:49:24.158933 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:49:24.158994 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:49:24.159064 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:49:24.159128 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:49:24.473281 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:49:41.894350 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:49:41.894429 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:49:41.894500 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:49:41.894562 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:49:41.894634 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:49:41.894696 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:49:41.894769 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:49:42.215823 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:49:52.155153 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:49:52.155265 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:49:52.155329 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:49:52.155393 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:49:52.155457 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:49:52.155519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:49:52.155585 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:49:52.471437 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:49:54.739021 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:49:54.739104 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:49:54.739173 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:49:54.739237 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:49:54.739303 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:49:54.739365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:49:54.739430 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:49:55.045313 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:50:22.730664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:50:22.730751 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:50:22.730842 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:50:22.730906 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:50:22.730974 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:50:22.731035 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:50:22.731101 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:50:23.044215 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:50:25.314388 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:50:25.314483 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:50:25.314549 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:50:25.314633 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:50:25.314696 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:50:25.314769 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:50:25.314837 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:50:25.621414 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:50:42.017368 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:50:42.017447 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:50:42.017525 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:50:42.017582 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:50:42.017650 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:50:42.017708 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:50:42.017784 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:50:42.344175 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:50:53.305458 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:50:53.306249 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:50:53.306353 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:50:53.306434 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:50:53.306512 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:50:53.306588 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:50:53.306685 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:50:53.611416 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:50:55.879411 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:50:55.879500 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:50:55.879567 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:50:55.879635 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:50:55.879706 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:50:55.879781 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:50:55.879847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:50:56.181548 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:51:23.868238 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:51:23.868316 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:51:23.868396 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:51:23.868457 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:51:23.868525 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:51:23.868588 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:51:23.868651 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:51:24.176065 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:51:26.445069 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:51:26.445153 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:51:26.445224 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:51:26.445285 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:51:26.445348 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:51:26.445408 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:51:26.445464 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:51:26.749670 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:51:42.139611 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:51:42.139741 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:51:42.139799 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:51:42.139866 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:51:42.139929 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:51:42.139992 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:51:42.140059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:51:42.456891 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:51:54.437294 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:51:54.437419 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:51:54.437479 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:51:54.437547 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:51:54.437611 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:51:54.437673 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:51:54.437737 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:51:54.741153 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:51:57.012856 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:51:57.012948 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:51:57.013015 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:51:57.013075 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:51:57.013157 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:51:57.013247 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:51:57.013322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:51:57.321679 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:52:25.006202 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:52:25.006309 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:52:25.006373 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:52:25.006441 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:52:25.006507 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:52:25.006576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:52:25.006636 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:52:25.322263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:52:27.591383 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:52:27.591474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:52:27.591543 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:52:27.591602 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:52:27.591663 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:52:27.591732 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:52:27.591802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:52:27.895019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:52:42.262866 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:52:42.262942 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:52:42.263015 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:52:42.263080 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:52:42.263143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:52:42.263202 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:52:42.263262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:52:42.574775 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:52:55.583341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:52:55.583466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:52:55.583525 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:52:55.583586 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:52:55.583644 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:52:55.583705 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:52:55.583768 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:52:55.890712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:52:58.155964 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:52:58.156052 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:52:58.156131 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:52:58.156202 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:52:58.156267 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:52:58.156346 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:52:58.156411 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:52:58.458749 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:53:26.152221 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:53:26.152328 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:53:26.152400 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:53:26.152466 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:53:26.152537 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:53:26.152600 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:53:26.152666 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:53:26.463183 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:53:28.717336 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:53:28.717422 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:53:28.717491 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:53:28.717551 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:53:28.717620 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:53:28.717679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:53:28.717750 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:53:29.029249 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:53:42.388516 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:53:42.388595 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:53:42.388661 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:53:42.388728 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:53:42.388790 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:53:42.388852 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:53:42.388927 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:53:42.697230 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:53:56.723383 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:53:56.723475 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:53:56.723561 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:53:56.723626 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:53:56.723686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:53:56.723758 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:53:56.723822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:53:57.027249 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:53:59.293695 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:53:59.293782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:53:59.293856 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:53:59.293933 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:53:59.293994 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:53:59.294050 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:53:59.294115 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:53:59.596830 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:54:27.294268 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:54:27.294942 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:54:27.295465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:54:27.295780 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:54:27.296359 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:54:27.296858 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:54:27.297485 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:54:27.600977 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:54:29.854500 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:54:29.854604 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:54:29.854682 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:54:29.854768 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:54:29.854838 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:54:29.854906 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:54:29.854982 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:54:30.176266 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:54:42.510260 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:54:42.510340 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:54:42.510406 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:54:42.510482 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:54:42.510545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:54:42.510606 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:54:42.510673 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:54:42.816088 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:54:57.864956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:54:57.865037 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:54:57.865105 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:54:57.865183 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:54:57.865244 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:54:57.865309 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:54:57.865367 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:54:58.182777 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:55:00.443157 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:55:00.443260 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:55:00.443325 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:55:00.443394 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:55:00.443458 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:55:00.443520 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:55:00.443580 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:55:00.751900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:55:28.440096 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:55:28.440188 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:55:28.440251 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:55:28.440328 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:55:28.440391 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:55:28.440451 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:55:28.440511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:55:28.749222 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:55:31.012076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:55:31.012188 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:55:31.012269 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:55:31.012353 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:55:31.012439 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:55:31.012508 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:55:31.012594 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:55:31.316298 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:55:42.634623 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:55:42.634704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:55:42.634779 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:55:42.634844 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:55:42.634910 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:55:42.634980 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:55:42.635049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:55:42.942991 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:55:59.014400 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:55:59.014494 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:55:59.014564 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:55:59.014634 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:55:59.014701 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:55:59.014770 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:55:59.014837 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:55:59.333734 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:56:01.578609 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:56:01.578691 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:56:01.578767 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:56:01.578830 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:56:01.578897 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:56:01.578963 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:56:01.579027 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:56:01.916033 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:56:29.592894 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:56:29.592998 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:56:29.593062 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:56:29.593126 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:56:29.593181 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:56:29.593249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:56:29.593310 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:56:29.902001 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:56:32.195791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:56:32.195874 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:56:32.195935 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:56:32.196012 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:56:32.196077 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:56:32.196143 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:56:32.196218 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:56:32.501677 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:56:42.757816 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:56:42.758179 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:56:42.758343 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:56:42.758480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:56:42.758638 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:56:42.759213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:56:42.759551 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:56:43.068144 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:57:00.169918 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:57:00.170009 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:57:00.170088 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:57:00.170148 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:57:00.170215 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:57:00.170285 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:57:00.170364 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:57:00.479357 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:57:02.760754 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:57:02.760838 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:57:02.760901 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:57:02.760977 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:57:02.761040 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:57:02.761107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:57:02.761167 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:57:03.075241 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:57:30.746105 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:57:30.746193 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:57:30.746252 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:57:30.746317 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:57:30.746379 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:57:30.746449 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:57:30.746526 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:57:31.052161 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:57:33.341136 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:57:33.341235 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:57:33.341305 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:57:33.341373 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:57:33.341431 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:57:33.341496 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:57:33.341556 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:57:33.645248 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:57:42.880040 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:57:42.880136 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:57:42.880200 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:57:42.880267 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:57:42.880333 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:57:42.880393 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:57:42.880449 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:57:43.191005 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:58:01.316556 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:58:01.316685 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:58:01.316776 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:58:01.316857 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:58:01.316948 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:58:01.317030 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:58:01.317106 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:58:01.624854 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:58:03.907944 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:58:03.908054 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:58:03.908140 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:58:03.908220 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:58:03.908295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:58:03.908368 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:58:03.908454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:58:04.220759 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:58:31.889741 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:58:31.889840 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:58:31.889920 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:58:31.889995 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:58:31.890060 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:58:31.890131 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:58:31.890201 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:58:32.209204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:58:34.480338 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:58:34.480459 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:58:34.480537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:58:34.480615 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:58:34.480696 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:58:34.480781 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:58:34.480863 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:58:34.784153 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:58:43.005870 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:58:43.005976 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:58:43.006050 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:58:43.006140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:58:43.006220 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:58:43.006297 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:58:43.006374 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:58:43.305861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:59:02.475907 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:59:02.475985 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:59:02.476058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:59:02.476133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:59:02.476214 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:59:02.476275 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:59:02.476347 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:59:02.780181 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:59:05.065394 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:59:05.065484 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:59:05.065552 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:59:05.065621 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:59:05.065685 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:59:05.065762 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:59:05.065830 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:59:05.370657 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:59:33.051195 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:59:33.051274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:59:33.051342 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:59:33.051411 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:59:33.051482 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:59:33.051545 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:59:33.051616 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:59:33.357841 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:59:35.635829 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:59:35.635917 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:59:35.636000 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:59:35.636061 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:59:35.636118 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:59:35.636181 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:59:35.636243 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:59:35.939169 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 15:59:43.131163 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 15:59:43.131250 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 15:59:43.131326 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 15:59:43.131396 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 15:59:43.131458 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 15:59:43.131530 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 15:59:43.131591 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 15:59:43.436238 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:00:03.620272 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:00:03.620549 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:00:03.620703 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:00:03.621430 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:00:03.621537 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:00:03.621607 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:00:03.621694 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:00:03.925081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:00:06.200796 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:00:06.200882 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:00:06.200953 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:00:06.201022 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:00:06.201093 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:00:06.201163 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:00:06.201233 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:00:06.508439 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:00:34.184026 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:00:34.184107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:00:34.184188 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:00:34.184256 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:00:34.184323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:00:34.184382 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:00:34.184444 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:00:34.491011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:00:36.771268 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:00:36.771363 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:00:36.771441 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:00:36.771499 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:00:36.771558 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:00:36.771620 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:00:36.771681 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:00:37.069069 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:00:43.255570 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:00:43.255647 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:00:43.255721 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:00:43.255789 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:00:43.255852 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:00:43.255921 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:00:43.255982 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:00:43.561118 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:01:04.748455 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:01:04.748541 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:01:04.748614 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:01:04.748677 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:01:04.748743 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:01:04.748813 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:01:04.748876 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:01:05.054146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:01:07.335500 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:01:07.335599 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:01:07.335694 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:01:07.335760 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:01:07.335834 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:01:07.335914 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:01:07.336005 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:01:07.643131 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:01:35.326507 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:01:35.326596 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:01:35.326663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:01:35.326746 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:01:35.326810 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:01:35.326879 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:01:35.326944 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:01:35.634122 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:01:37.907933 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:01:37.908017 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:01:37.908091 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:01:37.908155 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:01:37.908220 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:01:37.908281 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:01:37.908344 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:01:38.210259 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:01:43.382081 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:01:43.382158 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:01:43.382227 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:01:43.382293 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:01:43.382364 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:01:43.382431 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:01:43.382500 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:01:43.687737 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:02:05.895257 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:02:05.895347 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:02:05.895420 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:02:05.895480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:02:05.895546 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:02:05.895602 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:02:05.895672 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:02:06.212731 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:02:08.472555 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:02:08.472636 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:02:08.472716 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:02:08.472791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:02:08.472846 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:02:08.472909 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:02:08.472969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:02:08.772555 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:02:36.476125 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:02:36.476214 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:02:36.476281 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:02:36.476340 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:02:36.476406 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:02:36.477596 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:02:36.478618 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:02:36.780951 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:02:39.029095 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:02:39.029193 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:02:39.029274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:02:39.029350 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:02:39.029429 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:02:39.029509 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:02:39.029589 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:02:39.343158 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:02:43.510327 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:02:43.510414 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:02:43.510493 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:02:43.510567 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:02:43.510641 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:02:43.510715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:02:43.510800 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:02:43.811597 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:03:07.037287 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:03:07.037374 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:03:07.037442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:03:07.037506 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:03:07.037570 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:03:07.037634 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:03:07.037704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:03:07.340639 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:03:09.603057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:03:09.603157 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:03:09.603245 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:03:09.603321 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:03:09.603407 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:03:09.603485 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:03:09.603566 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:03:09.907070 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:03:37.601778 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:03:37.601874 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:03:37.601949 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:03:37.602017 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:03:37.602082 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:03:37.602163 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:03:37.602235 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:03:37.907871 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:03:40.177456 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:03:40.178785 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:03:40.179282 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:03:40.179937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:03:40.180244 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:03:40.181002 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:03:40.181095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:03:40.491238 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:03:43.639174 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:03:43.639264 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:03:43.639343 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:03:43.639418 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:03:43.639488 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:03:43.639559 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:03:43.639642 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:03:43.951757 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:04:08.173225 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:04:08.173313 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:04:08.173379 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:04:08.173448 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:04:08.173511 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:04:08.173579 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:04:08.173641 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:04:08.479018 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:04:10.753671 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:04:10.753772 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:04:10.753843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:04:10.753909 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:04:10.753982 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:04:10.754046 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:04:10.754118 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:04:11.060274 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:04:38.741807 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:04:38.741912 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:04:38.742004 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:04:38.742088 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:04:38.742169 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:04:38.742250 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:04:38.742324 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:04:39.049023 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:04:41.321933 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:04:41.322027 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:04:41.322105 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:04:41.322173 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:04:41.322238 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:04:41.322305 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:04:41.322379 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:04:41.629844 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:04:43.768472 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:04:43.768648 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:04:43.769157 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:04:43.770006 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:04:43.770135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:04:43.770206 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:04:43.770279 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:04:44.081746 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:05:09.317416 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:05:09.317536 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:05:09.317623 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:05:09.317701 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:05:09.317792 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:05:09.317874 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:05:09.317957 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:05:09.621940 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:05:11.900311 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:05:11.900401 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:05:11.900475 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:05:11.900551 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:05:11.900639 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:05:11.900713 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:05:11.900798 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:05:12.213818 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:05:39.875184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:05:39.875268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:05:39.875336 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:05:39.875399 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:05:39.875463 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:05:39.875531 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:05:39.875607 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:05:40.189014 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:05:42.475831 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:05:42.475937 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:05:42.476012 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:05:42.476100 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:05:42.476173 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:05:42.476252 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:05:42.476330 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:05:42.782832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:05:43.890830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:05:43.890935 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:05:43.891019 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:05:43.891100 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:05:43.891176 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:05:43.891252 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:05:43.891319 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:05:44.215031 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:06:10.456680 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:06:10.456787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:06:10.456870 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:06:10.456956 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:06:10.457032 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:06:10.457113 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:06:10.457194 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:06:10.766743 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:06:13.042413 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:06:13.042525 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:06:13.042599 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:06:13.042669 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:06:13.042747 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:06:13.042833 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:06:13.042902 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:06:13.347579 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:06:41.030194 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:06:41.030275 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:06:41.030352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:06:41.030412 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:06:41.030478 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:06:41.030540 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:06:41.030603 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:06:41.336566 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:06:43.612642 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:06:43.612753 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:06:43.612857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:06:43.612945 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:06:43.613024 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:06:43.613107 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:06:43.613181 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:06:43.926004 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:06:44.190102 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:06:44.190193 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:06:44.190281 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:06:44.190359 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:06:44.190447 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:06:44.190524 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:06:44.190610 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:06:44.502022 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:07:11.604093 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:07:11.604195 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:07:11.604270 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:07:11.604344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:07:11.604413 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:07:11.604478 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:07:11.604552 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:07:11.904063 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:07:14.192985 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:07:14.193114 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:07:14.193247 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:07:14.193541 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:07:14.194196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:07:14.194336 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:07:14.194412 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:07:14.510421 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:07:42.174581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:07:42.174689 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:07:42.174785 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:07:42.174860 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:07:42.174934 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:07:42.175021 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:07:42.175092 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:07:42.486631 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:07:44.140457 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:07:44.140542 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:07:44.140616 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:07:44.140682 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:07:44.140754 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:07:44.140826 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:07:44.140892 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:07:44.442861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:07:44.774038 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:07:44.774143 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:07:44.774206 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:07:44.774270 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:07:44.774336 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:07:44.774402 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:07:44.774462 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:07:45.069972 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:08:12.747628 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:08:12.747742 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:08:12.747817 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:08:12.747876 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:08:12.747945 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:08:12.748008 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:08:12.748077 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:08:13.057653 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:08:15.330580 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:08:15.330675 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:08:15.330741 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:08:15.330807 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:08:15.330871 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:08:15.330935 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:08:15.331002 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:08:15.635580 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:08:43.326573 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:08:43.326661 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:08:43.326769 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:08:43.326845 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:08:43.326935 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:08:43.327006 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:08:43.327070 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:08:43.637599 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:08:44.274796 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:08:44.274891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:08:44.274973 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:08:44.275054 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:08:44.275125 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:08:44.275205 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:08:44.275293 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:08:44.575263 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:08:45.901451 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:08:45.901547 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:08:45.901629 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:08:45.901706 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:08:45.901808 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:08:45.901889 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:08:45.901972 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:08:46.207012 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:09:13.908256 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:09:13.908384 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:09:13.908455 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:09:13.908526 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:09:13.908597 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:09:13.908668 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:09:13.908751 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:09:14.220817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:09:16.463638 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:09:16.463722 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:09:16.463793 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:09:16.463859 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:09:16.463931 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:09:16.463996 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:09:16.464065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:09:16.764840 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:09:44.398497 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:09:44.398592 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:09:44.398656 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:09:44.398732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:09:44.398801 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:09:44.398863 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:09:44.398931 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:09:44.704824 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:09:44.969395 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:09:44.969476 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:09:44.969551 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:09:44.969622 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:09:44.969688 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:09:44.969766 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:09:44.969835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:09:45.277900 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:09:47.024642 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:09:47.024756 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:09:47.024824 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:09:47.024886 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:09:47.024955 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:09:47.025021 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:09:47.025089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:09:47.329360 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:10:14.970842 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:10:14.970939 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:10:14.971007 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:10:14.971079 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:10:14.971149 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:10:14.971215 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:10:14.971279 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:10:15.282342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:10:17.588062 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:10:17.588146 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:10:17.588211 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:10:17.588278 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:10:17.588342 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:10:17.588412 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:10:17.588472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:10:17.896067 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:10:44.526563 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:10:44.526643 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:10:44.526729 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:10:44.526795 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:10:44.526859 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:10:44.526928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:10:44.526997 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:10:44.831340 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:10:45.551737 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:10:45.551824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:10:45.551915 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:10:45.551978 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:10:45.552050 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:10:45.552111 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:10:45.552171 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:10:45.857222 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:10:48.158516 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:10:48.158632 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:10:48.158727 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:10:48.158829 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:10:48.158922 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:10:48.159012 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:10:48.159092 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:10:48.458821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:11:16.127952 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:11:16.128066 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:11:16.128131 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:11:16.128201 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:11:16.128260 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:11:16.128320 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:11:16.128381 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:11:16.434372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:11:18.721513 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:11:18.721639 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:11:18.721724 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:11:18.721822 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:11:18.721906 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:11:18.721980 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:11:18.722054 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:11:19.027332 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:11:44.652546 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:11:44.652640 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:11:44.652720 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:11:44.652800 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:11:44.652874 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:11:44.652946 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:11:44.653026 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:11:44.961101 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:11:46.695029 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:11:46.695145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:11:46.695206 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:11:46.695276 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:11:46.695348 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:11:46.695414 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:11:46.695485 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:11:47.001131 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:11:49.294162 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:11:49.294266 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:11:49.294344 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:11:49.294428 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:11:49.294502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:11:49.294585 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:11:49.294670 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:11:49.596327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:12:17.263598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:12:17.263693 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:12:17.263787 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:12:17.263862 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:12:17.263931 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:12:17.263998 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:12:17.264068 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:12:17.570620 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:12:19.852559 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:12:19.852647 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:12:19.852727 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:12:19.852796 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:12:19.852865 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:12:19.852932 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:12:19.853007 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:12:20.174184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:12:44.778659 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:12:44.778743 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:12:44.778809 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:12:44.778875 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:12:44.778944 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:12:44.779009 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:12:44.779074 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:12:45.081727 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:12:47.841112 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:12:47.841199 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:12:47.841263 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:12:47.841335 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:12:47.841394 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:12:47.841461 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:12:47.841521 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:12:48.149135 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:12:50.440417 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:12:50.440514 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:12:50.440585 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:12:50.440654 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:12:50.440728 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:12:50.440788 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:12:50.440863 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:12:50.746215 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:13:18.413386 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:13:18.413487 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:13:18.413567 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:13:18.413646 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:13:18.413728 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:13:18.413803 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:13:18.413888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:13:18.712611 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:13:21.015975 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:13:21.016096 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:13:21.016179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:13:21.016260 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:13:21.016351 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:13:21.016425 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:13:21.016503 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:13:21.314257 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:13:44.903979 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:13:44.904072 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:13:44.904143 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:13:44.904220 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:13:44.904295 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:13:44.904354 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:13:44.904418 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:13:45.218728 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:13:48.977308 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:13:48.977388 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:13:48.977458 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:13:48.977523 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:13:48.977584 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:13:48.977649 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:13:48.977711 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:13:49.295088 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:13:51.569514 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:13:51.569621 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:13:51.569699 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:13:51.569791 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:13:51.569887 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:13:51.569961 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:13:51.570041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:13:51.879104 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:14:19.559672 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:14:19.559791 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:14:19.559869 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:14:19.559953 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:14:19.560030 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:14:19.560107 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:14:19.560186 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:14:19.867236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:14:22.162039 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:14:22.162213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:14:22.162341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:14:22.162466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:14:22.162599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:14:22.162739 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:14:22.162877 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:14:22.478537 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:14:45.035305 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:14:45.035413 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:14:45.035489 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:14:45.035565 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:14:45.035639 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:14:45.035722 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:14:45.035803 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:14:45.347036 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:14:50.135247 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:14:50.135332 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:14:50.135399 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:14:50.135465 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:14:50.135524 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:14:50.135589 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:14:50.135650 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:14:50.444422 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:14:52.740500 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:14:52.740583 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:14:52.740654 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:14:52.740728 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:14:52.740797 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:14:52.740858 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:14:52.740927 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:14:53.043554 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:15:20.704165 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:15:20.704248 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:15:20.704323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:15:20.704395 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:15:20.704968 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:15:20.705746 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:15:20.705907 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:15:21.011575 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:15:23.304055 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:15:23.304168 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:15:23.304230 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:15:23.304295 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:15:23.304361 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:15:23.304426 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:15:23.304487 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:15:23.610522 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:15:45.163865 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:15:45.163968 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:15:45.164054 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:15:45.164124 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:15:45.164196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:15:45.164272 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:15:45.164345 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:15:45.469165 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:15:51.272642 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:15:51.272755 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:15:51.272830 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:15:51.272904 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:15:51.272981 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:15:51.273050 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:15:51.273124 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:15:51.576624 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:15:53.869973 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:15:53.870077 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:15:53.870156 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:15:53.870217 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:15:53.870289 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:15:53.870355 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:15:53.870420 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:15:54.180068 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:16:21.836388 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:16:21.836516 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:16:21.836599 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:16:21.836671 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:16:21.836749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:16:21.836840 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:16:21.836913 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:16:22.157396 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:16:24.443856 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:16:24.443994 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:16:24.445389 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:16:24.446354 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:16:24.446662 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:16:24.446821 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:16:24.447378 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:16:24.752634 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:16:45.291788 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:16:45.291871 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:16:45.291934 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:16:45.292009 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:16:45.292078 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:16:45.292150 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:16:45.292224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:16:45.599673 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:16:52.426042 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:16:52.426130 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:16:52.426195 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:16:52.426258 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:16:52.426322 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:16:52.426382 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:16:52.426447 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:16:52.729944 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:16:55.007389 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:16:55.007485 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:16:55.007569 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:16:55.007645 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:16:55.007740 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:16:55.007817 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:16:55.007898 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:16:55.328739 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:17:22.989081 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:17:22.989186 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:17:22.989256 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:17:22.989329 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:17:22.989399 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:17:22.989479 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:17:22.989563 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:17:23.296988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:17:25.589852 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:17:25.589968 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:17:25.590039 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:17:25.590131 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:17:25.590207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:17:25.590289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:17:25.590364 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:17:25.891676 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:17:45.419483 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:17:45.419579 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:17:45.419649 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:17:45.419731 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:17:45.419803 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:17:45.419864 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:17:45.419935 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:17:45.722141 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:17:53.556398 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:17:53.556494 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:17:53.556563 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:17:53.556631 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:17:53.556699 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:17:53.556767 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:17:53.556838 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:17:53.861211 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:17:56.164489 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:17:56.164596 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:17:56.164691 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:17:56.164788 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:17:56.164872 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:17:56.164952 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:17:56.165047 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:17:56.472416 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:18:24.120222 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:18:24.120339 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:18:24.120416 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:18:24.120488 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:18:24.120561 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:18:24.120629 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:18:24.120709 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:18:24.448286 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:18:26.729527 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:18:26.729629 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:18:26.729707 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:18:26.729787 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:18:26.729874 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:18:26.729951 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:18:26.730027 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:18:27.036186 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:18:45.545457 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:18:45.545560 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:18:45.545638 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:18:45.545735 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:18:45.545806 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:18:45.545882 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:18:45.545953 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:18:45.851834 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:18:54.710096 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:18:54.710522 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:18:54.710669 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:18:54.710749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:18:54.710829 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:18:54.710903 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:18:54.710979 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:18:55.022610 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:18:57.297599 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:18:57.297685 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:18:57.297764 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:18:57.297835 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:18:57.297903 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:18:57.297969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:18:57.298033 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:18:57.602557 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:19:25.302213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:19:25.302299 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:19:25.302373 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:19:25.302439 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:19:25.302507 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:19:25.302573 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:19:25.302633 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:19:25.604614 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:19:27.862889 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:19:27.862985 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:19:27.863053 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:19:27.863115 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:19:27.863178 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:19:27.863243 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:19:27.863308 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:19:28.164812 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:19:45.672948 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:19:45.673029 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:19:45.673101 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:19:45.673162 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:19:45.673229 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:19:45.673290 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:19:45.673358 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:19:45.978085 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:19:55.865307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:19:55.865406 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:19:55.865472 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:19:55.865539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:19:55.865603 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:19:55.865664 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:19:55.865737 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:19:56.171090 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:19:58.426950 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:19:58.428000 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:19:58.428145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:19:58.428231 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:19:58.428313 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:19:58.428410 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:19:58.428545 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:19:58.736370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:20:26.432094 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:20:26.432189 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:20:26.432262 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:20:26.432333 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:20:26.432404 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:20:26.432471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:20:26.432538 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:20:26.741930 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:20:29.008983 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:20:29.009087 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:20:29.009154 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:20:29.009227 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:20:29.009291 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:20:29.009355 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:20:29.009417 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:20:29.325606 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:20:45.805454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:20:45.805558 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:20:45.805647 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:20:45.805720 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:20:45.805796 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:20:45.805864 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:20:45.805959 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:20:46.120079 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:20:57.006703 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:20:57.006822 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:20:57.006890 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:20:57.006957 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:20:57.007030 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:20:57.007089 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:20:57.007151 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:20:57.312363 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:20:59.589960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:20:59.590083 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:20:59.590147 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:20:59.590213 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:20:59.590275 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:20:59.590344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:20:59.590411 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:20:59.891877 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:21:27.573468 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:21:27.573546 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:21:27.573617 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:21:27.573686 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:21:27.573761 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:21:27.573825 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:21:27.573889 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:21:27.874074 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:21:30.156580 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:21:30.156663 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:21:30.156738 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:21:30.156804 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:21:30.156868 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:21:30.156935 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:21:30.157004 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:21:30.463881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:21:45.931300 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:21:45.931382 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:21:45.931462 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:21:45.931523 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:21:45.931592 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:21:45.931656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:21:45.931715 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:21:46.233294 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:21:58.129863 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:21:58.129946 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:21:58.130019 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:21:58.130086 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:21:58.130151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:21:58.130211 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:21:58.130277 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:21:58.444022 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:22:00.722530 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:22:00.722632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:22:00.722698 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:22:00.722771 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:22:00.722832 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:22:00.722897 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:22:00.722959 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:22:01.034057 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:22:28.701454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:22:28.701540 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:22:28.701623 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:22:28.701686 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:22:28.701766 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:22:28.701826 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:22:28.701894 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:22:29.015043 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:22:31.295042 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:22:31.295152 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:22:31.295230 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:22:31.295316 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:22:31.295392 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:22:31.295473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:22:31.295551 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:22:31.600869 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:22:46.059330 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:22:46.059421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:22:46.059501 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:22:46.059579 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:22:46.059657 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:22:46.059726 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:22:46.059797 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:22:46.366254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:22:59.285846 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:22:59.285945 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:22:59.286015 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:22:59.286076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:22:59.286154 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:22:59.286221 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:22:59.286282 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:22:59.592372 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:23:01.860865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:23:01.860990 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:23:01.861070 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:23:01.861142 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:23:01.861215 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:23:01.861297 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:23:01.861381 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:23:02.188142 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:23:29.850234 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:23:29.850373 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:23:29.850459 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:23:29.850537 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:23:29.850622 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:23:29.850711 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:23:29.850790 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:23:30.167646 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:23:32.458070 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:23:32.458175 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:23:32.458265 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:23:32.458353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:23:32.458434 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:23:32.458527 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:23:32.458599 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:23:32.760383 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:23:46.192660 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:23:46.192779 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:23:46.192863 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:23:46.192942 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:23:46.193025 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:23:46.193106 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:23:46.193183 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:23:46.498527 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:24:00.434842 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:24:00.434937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:24:00.435001 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:24:00.435073 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:24:00.435148 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:24:00.435218 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:24:00.435280 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:24:00.741783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:24:03.021756 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:24:03.021851 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:24:03.021934 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:24:03.022025 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:24:03.022101 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:24:03.022178 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:24:03.022258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:24:03.325336 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:24:31.005656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:24:31.005781 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:24:31.005882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:24:31.005964 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:24:31.006042 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:24:31.006124 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:24:31.006196 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:24:31.309528 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:24:33.585908 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:24:33.586007 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:24:33.586093 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:24:33.586182 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:24:33.586259 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:24:33.586364 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:24:33.586452 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:24:33.889742 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:24:46.324928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:24:46.325012 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:24:46.325095 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:24:46.325167 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:24:46.325234 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:24:46.325297 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:24:46.325362 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:24:46.633215 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:25:01.571698 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:25:01.571814 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:25:01.571884 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:25:01.571955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:25:01.572022 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:25:01.572083 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:25:01.572152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:25:01.883229 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:25:04.150035 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:25:04.150120 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:25:04.150182 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:25:04.150248 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:25:04.150316 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:25:04.150378 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:25:04.150439 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:25:04.460385 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:25:32.166676 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:25:32.166789 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:25:32.166872 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:25:32.166953 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:25:32.167025 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:25:32.167104 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:25:32.167181 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:25:32.469870 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:25:34.729262 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:25:34.729374 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:25:34.729452 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:25:34.729533 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:25:34.729615 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:25:34.729688 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:25:34.729788 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:25:35.037378 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:25:46.449653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:25:46.449782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:25:46.449868 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:25:46.449961 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:25:46.450044 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:25:46.450118 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:25:46.450195 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:25:46.753458 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:26:02.730685 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:26:02.730811 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:26:02.730896 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:26:02.730991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:26:02.731067 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:26:02.731145 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:26:02.731229 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:26:03.050860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:26:05.308533 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:26:05.308634 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:26:05.308721 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:26:05.308792 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:26:05.308862 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:26:05.308930 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:26:05.309000 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:26:05.617512 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:26:33.313617 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:26:33.313733 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:26:33.313796 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:26:33.313863 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:26:33.313924 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:26:33.313991 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:26:33.314050 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:26:33.616270 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:26:35.874752 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:26:35.874835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:26:35.874904 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:26:35.874982 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:26:35.875042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:26:35.875122 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:26:35.875179 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:26:36.183505 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:26:46.578487 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:26:46.578603 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:26:46.578696 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:26:46.578779 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:26:46.578860 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:26:46.578959 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:26:46.579041 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:26:46.882095 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:27:03.886139 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:27:03.886379 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:27:03.886545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:27:03.887218 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:27:03.887798 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:27:03.888299 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:27:03.888383 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:27:04.191614 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:27:06.451790 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:27:06.451908 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:27:06.451992 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:27:06.452076 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:27:06.452156 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:27:06.452231 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:27:06.452313 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:27:06.760627 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:27:34.447851 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:27:34.447951 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:27:34.448023 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:27:34.448096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:27:34.448162 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:27:34.448245 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:27:34.448312 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:27:34.748667 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:27:37.023856 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:27:37.023976 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:27:37.024056 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:27:37.024145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:27:37.024218 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:27:37.024296 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:27:37.024375 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:27:37.325757 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:27:46.708332 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:27:46.708419 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:27:46.708490 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:27:46.708564 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:27:46.708637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:27:46.708700 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:27:46.708787 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:27:47.017387 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:28:05.016388 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:28:05.016471 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:28:05.016550 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:28:05.016623 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:28:05.016692 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:28:05.016759 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:28:05.016827 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:28:05.329589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:28:07.587414 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:28:07.587528 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:28:07.587594 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:28:07.587676 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:28:07.587744 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:28:07.587813 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:28:07.587868 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:28:07.889916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:28:35.588846 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:28:35.588946 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:28:35.589013 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:28:35.589074 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:28:35.589142 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:28:35.589204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:28:35.589266 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:28:35.889114 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:28:38.146713 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:28:38.146799 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:28:38.146867 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:28:38.146940 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:28:38.147007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:28:38.147069 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:28:38.147131 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:28:38.456709 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:28:46.833124 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:28:46.833211 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:28:46.833274 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:28:46.833341 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:28:46.833402 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:28:46.833463 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:28:46.833535 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:28:47.150899 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:29:06.144843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:29:06.144929 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:29:06.144994 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:29:06.145050 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:29:06.145115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:29:06.145177 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:29:06.145243 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:29:06.455042 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:29:08.720259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:29:08.720345 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:29:08.720415 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:29:08.720476 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:29:08.720542 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:29:08.720602 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:29:08.720667 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:29:09.026867 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:29:36.718837 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:29:36.718934 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:29:36.719019 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:29:36.719112 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:29:36.719194 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:29:36.719288 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:29:36.719375 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:29:37.025408 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:29:39.295146 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:29:39.295256 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:29:39.295341 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:29:39.295423 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:29:39.295504 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:29:39.295581 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:29:39.295660 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:29:39.600809 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:29:46.955387 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:29:46.955501 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:29:46.955578 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:29:46.955657 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:29:46.955738 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:29:46.955815 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:29:46.955896 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:29:47.261787 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:30:07.287976 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:30:07.288093 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:30:07.288162 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:30:07.288240 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:30:07.288316 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:30:07.288388 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:30:07.288453 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:30:07.595562 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:30:09.859514 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:30:09.859607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:30:09.859679 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:30:09.859750 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:30:09.859823 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:30:09.859884 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:30:09.859953 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:30:10.167309 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:30:37.860232 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:30:37.860323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:30:37.860391 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:30:37.860462 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:30:37.860529 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:30:37.860594 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:30:37.860666 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:30:38.170921 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:30:40.431243 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:30:40.431360 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:30:40.431435 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:30:40.431502 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:30:40.431561 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:30:40.431622 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:30:40.431681 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:30:40.729492 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:30:47.081560 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:30:47.081642 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:30:47.081715 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:30:47.081795 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:30:47.081863 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:30:47.081930 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:30:47.081998 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:30:47.389858 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:31:08.431588 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:31:08.431687 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:31:08.431762 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:31:08.431822 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:31:08.431889 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:31:08.431959 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:31:08.432023 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:31:08.737815 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:31:10.992767 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:31:10.992856 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:31:10.992929 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:31:10.992993 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:31:10.993064 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:31:10.993124 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:31:10.993189 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:31:11.302501 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:31:39.001891 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:31:39.002171 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:31:39.003162 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:31:39.003289 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:31:39.003374 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:31:39.003454 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:31:39.003566 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:31:39.308912 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:31:41.577779 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:31:41.577909 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:31:41.577989 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:31:41.578074 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:31:41.578158 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:31:41.578240 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:31:41.578317 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:31:41.894051 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:31:47.208057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:31:47.208170 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:31:47.208253 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:31:47.208325 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:31:47.208401 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:31:47.208480 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:31:47.208560 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:31:47.515977 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:32:09.574116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:32:09.574210 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:32:09.574280 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:32:09.574349 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:32:09.574418 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:32:09.574490 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:32:09.574565 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:32:09.878988 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:32:12.172097 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:32:12.172199 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:32:12.172273 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:32:12.172343 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:32:12.172405 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:32:12.172468 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:32:12.172526 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:32:12.481453 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:32:40.153437 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:32:40.153539 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:32:40.153602 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:32:40.153665 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:32:40.153748 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:32:40.153817 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:32:40.153879 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:32:40.462792 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:32:42.742153 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:32:42.742262 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:32:42.742331 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:32:42.742405 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:32:42.742475 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:32:42.742559 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:32:42.742632 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:32:43.048382 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:32:47.330043 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:32:47.330144 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:32:47.330221 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:32:47.330289 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:32:47.330363 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:32:47.330430 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:32:47.330501 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:32:47.634938 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:33:10.720068 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:33:10.720156 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:33:10.720247 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:33:10.720308 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:33:10.720372 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:33:10.720430 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:33:10.720498 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:33:11.027278 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:33:13.309746 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:33:13.309830 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:33:13.309902 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:33:13.309974 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:33:13.310042 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:33:13.310107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:33:13.310176 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:33:13.611521 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:33:41.291571 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:33:41.291687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:33:41.291791 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:33:41.291885 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:33:41.291989 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:33:41.292064 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:33:41.292135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:33:41.602675 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:33:43.872835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:33:43.872947 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:33:43.873031 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:33:43.873112 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:33:43.873181 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:33:43.873266 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:33:43.873344 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:33:44.179546 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:33:47.458048 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:33:47.458831 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:33:47.458931 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:33:47.459018 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:33:47.459149 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:33:47.459273 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:33:47.459362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:33:47.774847 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:34:11.869606 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:34:11.869687 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:34:11.869778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:34:11.869871 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:34:11.869936 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:34:11.870010 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:34:11.870081 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:34:12.202313 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:34:14.446866 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:34:14.446974 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:34:14.447053 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:34:14.447127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:34:14.447209 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:34:14.447281 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:34:14.447357 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:34:14.750948 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:34:42.465335 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:34:42.465430 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:34:42.465498 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:34:42.465567 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:34:42.465627 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:34:42.465689 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:34:42.465765 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:34:42.773135 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:34:45.010304 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:34:45.010403 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:34:45.010468 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:34:45.010541 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:34:45.010605 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:34:45.010666 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:34:45.010731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:34:45.320173 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:34:47.575572 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:34:47.575676 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:34:47.575752 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:34:47.575814 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:34:47.575882 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:34:47.575943 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:34:47.576014 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:34:47.890584 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:35:13.038627 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:35:13.038710 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:35:13.038796 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:35:13.038863 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:35:13.038929 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:35:13.038995 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:35:13.039063 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:35:13.351023 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:35:15.578947 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:35:15.579026 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:35:15.579095 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:35:15.579159 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:35:15.579227 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:35:15.579293 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:35:15.579362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:35:15.887627 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:35:43.621304 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:35:43.621407 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:35:43.621474 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:35:43.621548 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:35:43.621614 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:35:43.621679 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:35:43.621749 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:35:43.932211 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:35:46.145150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:35:46.145256 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:35:46.145319 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:35:46.145390 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:35:46.145450 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:35:46.145516 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:35:46.145587 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:35:46.447576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:35:47.693190 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:35:47.693271 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:35:47.693349 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:35:47.693414 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:35:47.693475 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:35:47.693539 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:35:47.693601 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:35:48.003336 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:36:14.192549 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:36:14.192640 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:36:14.192706 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:36:14.192776 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:36:14.192844 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:36:14.192908 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:36:14.192968 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:36:14.518250 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:36:16.710061 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:36:16.710160 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:36:16.710228 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:36:16.710296 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:36:16.710363 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:36:16.710428 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:36:16.710493 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:36:17.011928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:36:44.785012 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:36:44.785098 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:36:44.785158 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:36:44.785231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:36:44.785291 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:36:44.785361 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:36:44.785427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:36:45.086074 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:36:47.273505 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:36:47.273589 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:36:47.273656 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:36:47.273734 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:36:47.273797 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:36:47.273866 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:36:47.273929 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:36:47.575446 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:36:47.848529 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:36:47.848628 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:36:47.848710 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:36:47.848808 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:36:47.848898 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:36:47.848989 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:36:47.849068 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:36:48.150414 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:37:15.351970 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:37:15.352071 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:37:15.352148 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:37:15.352214 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:37:15.352289 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:37:15.352355 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:37:15.352431 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:37:15.654669 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:37:17.851408 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:37:17.852357 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:37:17.853328 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:37:17.853427 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:37:17.853519 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:37:17.853592 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:37:17.853663 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:37:18.163152 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:37:45.915964 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:37:45.916055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:37:45.916117 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:37:45.916183 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:37:45.916248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:37:45.916315 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:37:45.916375 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:37:46.219658 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:37:47.934356 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:37:47.934442 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:37:47.934515 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:37:47.934582 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:37:47.934653 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:37:47.934727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:37:47.934804 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:37:48.233270 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:37:48.500102 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:37:48.500189 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:37:48.500267 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:37:48.500340 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:37:48.500405 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:37:48.500477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:37:48.500544 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:37:48.806601 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:38:16.483020 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:38:16.483111 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:38:16.483183 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:38:16.483259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:38:16.483333 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:38:16.483400 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:38:16.483490 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:38:16.793078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:38:19.070293 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:38:19.070395 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:38:19.070478 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:38:19.070557 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:38:19.070649 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:38:19.070731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:38:19.070835 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:38:19.383211 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:38:47.054932 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:38:47.055043 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:38:47.055107 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:38:47.055183 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:38:47.055247 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:38:47.055317 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:38:47.055380 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:38:47.374681 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:38:48.060412 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:38:48.060497 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:38:48.060560 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:38:48.060622 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:38:48.060684 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:38:48.060761 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:38:48.060821 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:38:48.363206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:38:49.646586 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:38:49.646711 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:38:49.646790 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:38:49.646852 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:38:49.646920 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:38:49.646981 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:38:49.647047 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:38:49.968025 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:39:17.637097 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:39:17.637181 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:39:17.637242 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:39:17.637313 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:39:17.637375 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:39:17.637440 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:39:17.637500 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:39:17.945589 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:39:20.248189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:39:20.248271 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:39:20.248341 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:39:20.248400 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:39:20.248471 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:39:20.248534 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:39:20.248596 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:39:20.564011 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:39:48.183221 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:39:48.183326 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:39:48.183409 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:39:48.183489 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:39:48.183570 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:39:48.183651 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:39:48.183749 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:39:48.487192 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:39:48.742817 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:39:48.742909 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:39:48.742994 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:39:48.743065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:39:48.743144 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:39:48.743218 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:39:48.743294 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:39:49.046588 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:39:50.835565 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:39:50.835680 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:39:50.835774 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:39:50.835855 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:39:50.835938 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:39:50.836011 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:39:50.836093 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:39:51.139031 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:40:18.743607 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:40:18.743732 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:40:18.743804 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:40:18.743886 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:40:18.743971 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:40:18.744048 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:40:18.744142 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:40:19.053434 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:40:21.394096 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:40:21.394518 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:40:21.394755 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:40:21.394864 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:40:21.394966 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:40:21.395053 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:40:21.395131 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:40:21.705236 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:40:48.305365 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:40:48.305614 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:40:48.306734 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:40:48.306881 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:40:48.306960 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:40:48.307057 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:40:48.307131 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:40:48.618105 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:40:49.316454 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:40:49.316550 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:40:49.316626 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:40:49.316709 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:40:49.316806 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:40:49.316879 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:40:49.316945 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:40:49.619538 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:40:51.974156 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:40:51.974273 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:40:51.974339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:40:51.974404 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:40:51.974478 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:40:51.974544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:40:51.974607 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:40:52.312584 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:41:19.878739 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:41:19.878824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:41:19.878888 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:41:19.878958 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:41:19.879017 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:41:19.879082 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:41:19.879141 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:41:20.200084 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:41:22.577461 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:41:22.577544 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:41:22.577621 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:41:22.577684 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:41:22.577758 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:41:22.577819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:41:22.577885 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:41:22.878489 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:41:48.424627 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:41:48.424712 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:41:48.424783 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:41:48.424849 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:41:48.424911 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:41:48.424979 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:41:48.425041 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:41:48.741572 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:41:50.467768 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:41:50.467871 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:41:50.467954 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:41:50.468027 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:41:50.468102 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:41:50.468190 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:41:50.468264 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:41:50.775215 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:41:53.137563 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:41:53.137647 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:41:53.137726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:41:53.137792 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:41:53.137858 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:41:53.137923 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:41:53.137987 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:41:53.447057 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:42:21.033356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:42:21.033471 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:42:21.033548 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:42:21.033636 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:42:21.033722 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:42:21.033805 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:42:21.033876 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:42:21.334915 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:42:23.708515 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:42:23.708612 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:42:23.708689 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:42:23.708771 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:42:23.708847 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:42:23.708928 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:42:23.708997 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:42:24.017094 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:42:48.545340 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:42:48.545422 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:42:48.545485 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:42:48.545552 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:42:48.545621 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:42:48.545682 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:42:48.545751 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:42:48.850544 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:42:51.594322 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:42:51.594407 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:42:51.594469 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:42:51.594546 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:42:51.594607 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:42:51.594666 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:42:51.594728 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:42:51.911336 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:42:54.280482 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:42:54.280570 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:42:54.280642 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:42:54.280706 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:42:54.280778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:42:54.280849 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:42:54.280916 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:42:54.587860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:43:22.192239 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:43:22.192327 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:43:22.192400 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:43:22.192469 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:43:22.192538 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:43:22.192606 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:43:22.192673 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:43:22.500896 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:43:24.846335 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:43:24.846438 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:43:24.846505 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:43:24.846574 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:43:24.846635 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:43:24.846703 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:43:24.846768 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:43:25.157402 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:43:48.666532 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:43:48.666645 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:43:48.666731 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:43:48.666822 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:43:48.666907 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:43:48.667005 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:43:48.667080 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:43:48.976318 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:43:52.772202 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:43:52.772305 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:43:52.772380 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:43:52.772466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:43:52.772544 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:43:52.772625 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:43:52.772694 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:43:53.073615 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:43:55.419785 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:43:55.419887 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:43:55.419961 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:43:55.420037 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:43:55.420123 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:43:55.420197 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:43:55.420262 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:43:55.722946 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:44:23.341000 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:44:23.341097 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:44:23.341176 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:44:23.341245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:44:23.341314 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:44:23.341379 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:44:23.341449 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:44:23.648405 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:44:25.986403 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:44:25.986484 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:44:25.986550 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:44:25.986625 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:44:25.986683 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:44:25.986748 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:44:25.986809 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:44:26.287243 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:44:48.790508 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:44:48.790595 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:44:48.790664 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:44:48.790745 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:44:48.790804 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:44:48.790871 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:44:48.790935 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:44:49.094079 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:44:53.915784 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:44:53.915869 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:44:53.915944 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:44:53.916009 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:44:53.916068 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:44:53.916133 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:44:53.916194 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:44:54.234149 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:44:56.550500 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:44:56.550598 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:44:56.550664 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:44:56.550737 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:44:56.550803 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:44:56.550866 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:44:56.550923 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:44:56.852464 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:45:24.498861 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:45:24.498965 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:45:24.499030 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:45:24.499094 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:45:24.499158 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:45:24.499230 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:45:24.499310 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:45:24.808448 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:45:27.112618 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:45:27.112739 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:45:27.112804 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:45:27.112887 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:45:27.112947 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:45:27.113009 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:45:27.113075 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:45:27.413772 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:45:48.912810 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:45:48.912896 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:45:48.912973 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:45:48.913040 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:45:48.913106 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:45:48.913168 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:45:48.913239 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:45:49.223677 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:45:55.076495 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:45:55.076647 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:45:55.076792 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:45:55.076917 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:45:55.077056 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:45:55.077185 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:45:55.077301 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:45:55.387442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:45:57.675125 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:45:57.675220 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:45:57.675298 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:45:57.675369 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:45:57.675444 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:45:57.675508 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:45:57.675574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:45:57.978510 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:46:25.647614 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:46:25.647738 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:46:25.647825 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:46:25.647906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:46:25.647984 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:46:25.648064 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:46:25.648128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:46:25.951148 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:46:28.243292 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:46:28.243403 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:46:28.243489 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:46:28.243572 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:46:28.243655 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:46:28.243736 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:46:28.243817 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:46:28.547320 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:46:49.042098 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:46:49.042201 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:46:49.042280 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:46:49.042364 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:46:49.042446 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:46:49.042520 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:46:49.042601 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:46:49.351973 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:46:56.212408 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:46:56.212523 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:46:56.212605 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:46:56.212677 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:46:56.212763 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:46:56.212826 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:46:56.212900 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:46:56.518160 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:46:58.806351 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:46:58.806465 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:46:58.806538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:46:58.806626 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:46:58.806712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:46:58.806819 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:46:58.806893 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:46:59.121118 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:47:26.779329 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:47:26.779422 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:47:26.779497 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:47:26.779577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:47:26.779653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:47:26.779729 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:47:26.779790 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:47:27.083855 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:47:29.403824 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:47:29.403910 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:47:29.403989 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:47:29.404055 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:47:29.404138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:47:29.404233 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:47:29.404303 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:47:29.707552 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:47:49.168545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:47:49.168628 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:47:49.168697 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:47:49.168768 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:47:49.168839 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:47:49.168906 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:47:49.168966 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:47:49.481394 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:47:57.347354 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:47:57.347441 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:47:57.347519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:47:57.347579 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:47:57.347647 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:47:57.347708 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:47:57.347788 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:47:57.652440 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:47:59.970066 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:47:59.970148 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:47:59.970238 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:47:59.970310 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:47:59.970372 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:47:59.970437 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:47:59.970497 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:48:00.299280 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:48:27.914942 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:48:27.915044 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:48:27.915111 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:48:27.915174 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:48:27.915238 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:48:27.915305 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:48:27.915362 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:48:28.218753 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:48:30.558837 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:48:30.558935 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:48:30.558995 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:48:30.559060 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:48:30.559134 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:48:30.559204 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:48:30.559261 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:48:30.862514 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:48:49.297124 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:48:49.297224 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:48:49.297299 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:48:49.297378 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:48:49.297473 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:48:49.297544 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:48:49.297607 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:48:49.604666 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:48:58.478709 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:48:58.478802 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:48:58.478875 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:48:58.478933 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:48:58.479001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:48:58.479058 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:48:58.479121 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:48:58.783729 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:49:01.122921 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:49:01.123000 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:49:01.123067 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:49:01.123148 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:49:01.123217 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:49:01.123285 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:49:01.123348 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:49:01.437616 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:49:29.045946 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:49:29.046028 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:49:29.046099 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:49:29.046163 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:49:29.046232 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:49:29.046300 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:49:29.046375 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:49:29.356248 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:49:31.699955 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:49:31.700049 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:49:31.700126 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:49:31.700230 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:49:31.700303 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:49:31.700373 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:49:31.700453 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:49:32.007411 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:49:49.414651 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:49:49.414748 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:49:49.414810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:49:49.414881 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:49:49.414945 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:49:49.415013 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:49:49.415069 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:49:49.719574 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:49:59.620113 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:49:59.620196 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:49:59.620266 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:49:59.620329 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:49:59.620388 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:49:59.620457 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:49:59.620521 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:49:59.926901 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:50:02.289575 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:50:02.289695 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:50:02.289812 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:50:02.289886 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:50:02.289960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:50:02.290028 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:50:02.290099 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:50:02.602451 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:50:30.201037 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:50:30.201130 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:50:30.201205 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:50:30.201267 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:50:30.201337 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:50:30.201403 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:50:30.201467 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:50:30.507861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:50:32.861995 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:50:32.862080 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:50:32.862165 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:50:32.862228 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:50:32.862296 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:50:32.862355 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:50:32.862418 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:50:33.162582 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:50:38.157146 I | op-k8sutil: ROOK_CEPH_COMMANDS_TIMEOUT_SECONDS="15" (default) >2022-11-24 16:50:38.157187 I | op-k8sutil: ROOK_LOG_LEVEL="INFO" (env var) >2022-11-24 16:50:38.157195 I | op-k8sutil: ROOK_ENABLE_DISCOVERY_DAEMON="false" (env var) >2022-11-24 16:50:38.159781 I | operator: rook-ceph-operator-config-controller done reconciling >2022-11-24 16:50:49.532770 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:50:49.532854 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:50:49.532941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:50:49.533004 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:50:49.533069 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:50:49.533135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:50:49.533208 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:50:49.836887 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:51:00.770381 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:51:00.770498 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:51:00.770576 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:51:00.770644 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:51:00.770709 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:51:00.770779 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:51:00.770843 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:51:01.070934 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:51:03.425329 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:51:03.425413 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:51:03.425477 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:51:03.425540 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:51:03.425608 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:51:03.425674 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:51:03.425744 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:51:03.725595 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:51:31.328570 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:51:31.328661 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:51:31.328736 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:51:31.328805 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:51:31.328864 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:51:31.328930 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:51:31.328994 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:51:31.631126 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:51:33.986837 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:51:33.986959 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:51:33.987032 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:51:33.987108 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:51:33.987187 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:51:33.987259 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:51:33.987328 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:51:34.298813 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:51:49.652707 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:51:49.652808 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:51:49.652879 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:51:49.652942 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:51:49.653008 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:51:49.653074 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:51:49.653139 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:51:49.965355 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:52:01.891252 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:52:01.891365 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:52:01.891447 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:52:01.891532 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:52:01.891611 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:52:01.891691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:52:01.891782 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:52:02.226228 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:52:04.562172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:52:04.562942 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:52:04.563804 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:52:04.563934 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:52:04.564022 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:52:04.564105 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:52:04.564195 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:52:04.875541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:52:32.489545 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:52:32.489641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:52:32.489714 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:52:32.489799 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:52:32.489876 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:52:32.489951 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:52:32.490027 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:52:32.795045 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:52:35.137089 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:52:35.137197 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:52:35.137263 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:52:35.137335 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:52:35.137400 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:52:35.137461 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:52:35.137520 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:52:35.440262 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:52:49.780650 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:52:49.780782 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:52:49.780872 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:52:49.780954 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:52:49.781041 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:52:49.781115 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:52:49.781194 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:52:50.102020 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:53:03.067336 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:53:03.067446 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:53:03.067518 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:53:03.067583 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:53:03.067660 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:53:03.067741 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:53:03.067812 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:53:03.370442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:53:05.701450 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:53:05.701560 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:53:05.701643 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:53:05.701733 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:53:05.701817 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:53:05.701893 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:53:05.701992 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:53:06.002617 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:53:33.635285 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:53:33.635389 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:53:33.635473 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:53:33.635559 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:53:33.635637 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:53:33.635726 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:53:33.635805 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:53:33.936006 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:53:36.269632 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:53:36.269753 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:53:36.269833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:53:36.269913 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:53:36.270009 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:53:36.270092 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:53:36.270176 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:53:36.571146 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:53:49.908494 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:53:49.908582 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:53:49.908658 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:53:49.908740 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:53:49.908814 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:53:49.908889 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:53:49.908957 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:53:50.234165 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:54:04.204035 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:54:04.204133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:54:04.204199 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:54:04.204262 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:54:04.204326 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:54:04.204382 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:54:04.204444 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:54:04.509431 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:54:06.825151 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:54:06.825234 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:54:06.825311 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:54:06.825374 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:54:06.825442 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:54:06.825506 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:54:06.825569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:54:07.132060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:54:34.772826 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:54:34.772953 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:54:34.773053 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:54:34.773160 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:54:34.773248 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:54:34.773332 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:54:34.773411 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:54:35.084836 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:54:37.398273 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:54:37.398386 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:54:37.398464 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:54:37.398538 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:54:37.398593 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:54:37.398667 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:54:37.398744 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:54:37.706683 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:54:50.031139 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:54:50.031219 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:54:50.031283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:54:50.031349 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:54:50.031415 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:54:50.031479 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:54:50.031544 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:54:50.338951 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:55:05.343971 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:55:05.344065 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:55:05.344135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:55:05.344201 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:55:05.344262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:55:05.344330 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:55:05.344394 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:55:05.654478 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:55:07.968778 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:55:07.968871 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:55:07.968943 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:55:07.969008 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:55:07.969075 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:55:07.969134 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:55:07.969196 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:55:08.277636 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:55:35.921117 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:55:35.921219 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:55:35.921303 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:55:35.921365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:55:35.921422 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:55:35.921497 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:55:35.921564 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:55:36.222319 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:55:38.537591 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:55:38.537679 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:55:38.537757 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:55:38.537837 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:55:38.537912 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:55:38.537977 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:55:38.538043 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:55:38.852817 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:55:50.152625 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:55:50.152712 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:55:50.152784 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:55:50.152853 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:55:50.152913 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:55:50.152983 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:55:50.153046 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:55:50.462199 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:56:06.491000 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:56:06.491110 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:56:06.491186 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:56:06.491276 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:56:06.491347 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:56:06.491426 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:56:06.491509 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:56:06.796783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:56:09.112836 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:56:09.112952 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:56:09.113028 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:56:09.113108 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:56:09.113186 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:56:09.113261 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:56:09.113337 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:56:09.439544 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:56:37.054866 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:56:37.054983 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:56:37.055057 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:56:37.055129 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:56:37.055187 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:56:37.055258 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:56:37.055315 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:56:37.363634 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:56:39.703234 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:56:39.703648 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:56:39.703864 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:56:39.704509 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:56:39.704608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:56:39.704706 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:56:39.704836 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:56:40.006008 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:56:50.275165 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:56:50.275285 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:56:50.275371 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:56:50.275453 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:56:50.275528 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:56:50.275612 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:56:50.275684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:56:50.586054 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:57:07.624742 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:57:07.624847 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:57:07.624927 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:57:07.625008 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:57:07.625092 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:57:07.625171 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:57:07.625246 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:57:07.929086 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:57:10.282844 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:57:10.282960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:57:10.283047 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:57:10.283123 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:57:10.283206 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:57:10.283286 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:57:10.283365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:57:10.588376 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:57:38.189140 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:57:38.189226 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:57:38.189286 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:57:38.189349 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:57:38.189414 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:57:38.189485 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:57:38.189552 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:57:38.496208 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:57:40.853004 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:57:40.853101 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:57:40.853185 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:57:40.853269 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:57:40.853343 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:57:40.853418 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:57:40.853499 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:57:41.166836 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:57:50.397414 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:57:50.398213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:57:50.398883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:57:50.399024 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:57:50.399139 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:57:50.399257 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:57:50.399344 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:57:50.705611 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:58:08.755551 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:58:08.755662 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:58:08.755740 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:58:08.755806 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:58:08.755871 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:58:08.755933 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:58:08.756001 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:58:09.058138 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:58:11.434955 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:58:11.435062 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:58:11.435138 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:58:11.435214 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:58:11.435290 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:58:11.435358 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:58:11.435425 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:58:11.748396 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:58:39.321119 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:58:39.321216 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:58:39.321288 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:58:39.321351 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:58:39.321417 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:58:39.321490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:58:39.321555 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:58:39.624927 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:58:42.009492 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:58:42.009603 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:58:42.009685 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:58:42.009768 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:58:42.009858 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:58:42.009949 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:58:42.010021 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:58:42.334785 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:58:50.519255 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:58:50.519351 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:58:50.519426 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:58:50.519500 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:58:50.519576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:58:50.519648 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:58:50.519726 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:58:50.822545 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:59:09.885037 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:59:09.885161 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:59:09.885242 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:59:09.885317 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:59:09.885403 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:59:09.885494 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:59:09.885568 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:59:10.205109 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:59:12.594218 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:59:12.594323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:59:12.594397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:59:12.594471 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:59:12.594548 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:59:12.594615 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:59:12.594685 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:59:12.895254 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:59:40.465134 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:59:40.465234 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:59:40.465302 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:59:40.465366 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:59:40.465434 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:59:40.465501 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:59:40.465562 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:59:40.771772 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:59:43.160082 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:59:43.160165 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:59:43.160230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:59:43.160308 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:59:43.160367 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:59:43.160423 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:59:43.160487 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:59:43.465271 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 16:59:50.648555 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 16:59:50.648632 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 16:59:50.648704 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 16:59:50.648772 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 16:59:50.648835 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 16:59:50.648897 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 16:59:50.648964 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 16:59:50.951287 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:00:11.034261 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:00:11.034379 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:00:11.034449 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:00:11.034516 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:00:11.034586 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:00:11.034655 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:00:11.034715 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:00:11.333679 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:00:13.730207 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:00:13.730306 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:00:13.730406 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:00:13.730505 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:00:13.730601 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:00:13.730703 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:00:13.730785 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:00:14.037362 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:00:41.593514 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:00:41.593603 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:00:41.593678 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:00:41.593760 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:00:41.593824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:00:41.593893 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:00:41.593964 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:00:41.894318 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:00:44.303846 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:00:44.303961 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:00:44.304052 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:00:44.304127 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:00:44.304218 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:00:44.304309 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:00:44.304387 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:00:44.608827 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:00:50.773972 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:00:50.774087 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:00:50.774170 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:00:50.774251 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:00:50.774321 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:00:50.774402 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:00:50.774473 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:00:51.076221 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:01:12.156612 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:01:12.156707 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:01:12.156793 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:01:12.156874 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:01:12.156946 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:01:12.157028 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:01:12.157112 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:01:12.464675 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:01:14.864984 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:01:14.865108 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:01:14.865184 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:01:14.865262 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:01:14.865332 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:01:14.865428 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:01:14.865504 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:01:15.169086 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:01:42.726474 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:01:42.726574 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:01:42.726653 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:01:42.726729 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:01:42.726808 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:01:42.726888 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:01:42.726969 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:01:43.037526 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:01:45.426041 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:01:45.426155 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:01:45.426241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:01:45.426315 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:01:45.426395 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:01:45.426472 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:01:45.426546 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:01:45.728972 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:01:50.898310 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:01:50.898417 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:01:50.898492 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:01:50.898567 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:01:50.898636 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:01:50.898714 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:01:50.898789 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:01:51.203919 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:02:13.302457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:02:13.302542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:02:13.302606 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:02:13.302668 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:02:13.302739 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:02:13.302807 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:02:13.302871 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:02:13.607708 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:02:15.983533 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:02:15.983616 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:02:15.983683 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:02:15.983753 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:02:15.983814 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:02:15.983873 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:02:15.983936 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:02:16.283054 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:02:43.866130 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:02:43.866219 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:02:43.866291 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:02:43.866363 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:02:43.866428 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:02:43.866491 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:02:43.866552 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:02:44.170298 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:02:46.538902 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:02:46.538989 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:02:46.539065 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:02:46.539129 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:02:46.539190 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:02:46.539252 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:02:46.539315 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:02:46.843438 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:02:51.026485 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:02:51.026561 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:02:51.026629 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:02:51.026694 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:02:51.026766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:02:51.026827 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:02:51.026892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:02:51.331235 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:03:14.430376 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:03:14.430464 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:03:14.430542 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:03:14.430604 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:03:14.430670 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:03:14.430732 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:03:14.430793 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:03:14.735789 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:03:17.106409 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:03:17.106520 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:03:17.106598 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:03:17.106678 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:03:17.106789 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:03:17.106866 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:03:17.106954 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:03:17.413136 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:03:44.993372 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:03:44.993495 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:03:44.993575 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:03:44.993644 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:03:44.993710 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:03:44.993790 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:03:44.993869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:03:45.298871 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:03:47.680239 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:03:47.680338 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:03:47.680418 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:03:47.680494 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:03:47.680576 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:03:47.680645 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:03:47.680715 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:03:47.993740 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:03:51.156523 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:03:51.156604 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:03:51.156677 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:03:51.156752 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:03:51.156829 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:03:51.156897 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:03:51.156963 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:03:51.465206 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:04:15.562270 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:04:15.562350 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:04:15.562420 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:04:15.562486 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:04:15.562544 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:04:15.562624 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:04:15.562686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:04:15.866469 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:04:18.257634 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:04:18.257741 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:04:18.257805 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:04:18.257869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:04:18.257935 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:04:18.258000 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:04:18.258060 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:04:18.564998 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:04:46.126780 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:04:46.126865 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:04:46.126945 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:04:46.127010 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:04:46.127072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:04:46.127128 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:04:46.127204 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:04:46.435176 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:04:48.824350 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:04:48.824434 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:04:48.824509 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:04:48.824571 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:04:48.824645 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:04:48.824710 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:04:48.824779 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:04:49.129682 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:04:51.283732 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:04:51.283819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:04:51.283883 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:04:51.283945 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:04:51.284012 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:04:51.284074 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:04:51.284133 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:04:51.593536 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:05:16.701660 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:05:16.701754 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:05:16.701820 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:05:16.701899 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:05:16.701958 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:05:16.702024 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:05:16.702090 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:05:17.007413 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:05:19.398504 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:05:19.398596 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:05:19.398666 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:05:19.398752 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:05:19.398812 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:05:19.398876 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:05:19.398937 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:05:19.699512 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:05:47.268700 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:05:47.268826 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:05:47.268909 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:05:47.268987 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:05:47.269064 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:05:47.269141 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:05:47.269215 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:05:47.572446 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:05:49.970749 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:05:49.970876 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:05:49.970953 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:05:49.971029 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:05:49.971107 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:05:49.971184 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:05:49.971255 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:05:50.303540 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:05:51.414856 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:05:51.415010 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:05:51.415100 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:05:51.415185 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:05:51.415304 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:05:51.415399 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:05:51.415487 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:05:51.715822 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:06:17.848563 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:06:17.848685 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:06:17.848777 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:06:17.848861 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:06:17.848931 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:06:17.849013 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:06:17.849084 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:06:18.154456 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:06:20.565059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:06:20.565136 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:06:20.565218 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:06:20.565297 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:06:20.565363 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:06:20.565421 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:06:20.565483 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:06:20.868595 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:06:48.414836 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:06:48.414954 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:06:48.415048 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:06:48.415118 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:06:48.415190 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:06:48.415259 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:06:48.415323 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:06:48.720183 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:06:51.128165 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:06:51.128274 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:06:51.128349 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:06:51.128427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:06:51.128492 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:06:51.128563 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:06:51.128631 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:06:51.433986 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:06:51.698208 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:06:51.698311 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:06:51.698418 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:06:51.698505 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:06:51.698581 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:06:51.698664 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:06:51.698742 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:06:52.013047 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:07:18.978151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:07:18.978302 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:07:18.978377 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:07:18.978492 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:07:18.978580 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:07:18.978671 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:07:18.978765 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:07:19.294042 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 17:07:21.700012 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:07:21.700113 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:07:21.700184 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:07:21.700252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:07:21.700325 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:07:21.700401 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:07:21.700471 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:07:22.020133 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 17:07:49.556338 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:07:49.556439 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:07:49.556500 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:07:49.556565 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:07:49.556631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:07:49.556690 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:07:49.556766 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:07:49.863128 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 17:07:51.669398 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:07:51.669511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:07:51.669594 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:07:51.669681 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:07:51.669787 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:07:51.669869 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:07:51.669956 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:07:51.984576 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 17:07:52.283482 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:07:52.283572 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:07:52.283647 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:07:52.283738 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:07:52.283833 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:07:52.283908 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:07:52.283981 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:07:52.598220 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:384} {StateName:active+undersized+degraded Count:224} {StateName:active+clean Count:1}]" >2022-11-24 17:08:20.128635 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:08:20.128746 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:08:20.128815 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:08:20.128889 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:08:20.128952 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:08:20.129019 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:08:20.129091 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:08:20.433155 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:08:22.871985 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:08:22.872095 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:08:22.872179 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:08:22.872274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:08:22.872359 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:08:22.872446 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:08:22.872530 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:08:23.183860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:08:50.695812 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:08:50.695928 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:08:50.696004 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:08:50.696087 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:08:50.696161 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:08:50.696239 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:08:50.696311 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:08:50.996935 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:08:51.801214 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:08:51.801312 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:08:51.801389 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:08:51.801463 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:08:51.801532 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:08:51.801609 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:08:51.801678 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:08:52.122918 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:08:53.446808 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:08:53.446925 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:08:53.446998 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:08:53.447065 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:08:53.447130 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:08:53.447202 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:08:53.447264 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:08:53.750031 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:09:21.255989 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:09:21.256091 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:09:21.256173 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:09:21.256254 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:09:21.256334 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:09:21.256421 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:09:21.256492 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:09:21.562566 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:09:24.010668 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:09:24.010767 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:09:24.010840 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:09:24.010913 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:09:24.010994 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:09:24.011067 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:09:24.011138 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:09:24.329860 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:09:51.831737 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:09:51.831836 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:09:51.831931 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:09:51.832008 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:09:51.832086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:09:51.832166 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:09:51.832252 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:09:52.157824 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:09:52.424360 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:09:52.424470 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:09:52.424544 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:09:52.424618 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:09:52.424692 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:09:52.424770 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:09:52.424848 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:09:52.737389 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:09:54.595071 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:09:54.595164 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:09:54.595232 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:09:54.595303 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:09:54.595369 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:09:54.595431 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:09:54.595495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:09:54.902971 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:10:22.425671 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:10:22.425784 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:10:22.425849 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:10:22.425931 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:10:22.425992 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:10:22.426056 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:10:22.426127 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:10:22.733550 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:10:25.179050 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:10:25.179134 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:10:25.179206 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:10:25.179267 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:10:25.179332 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:10:25.179400 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:10:25.179460 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:10:25.485911 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:10:52.054072 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:10:52.054172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:10:52.054259 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:10:52.054348 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:10:52.054454 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:10:52.054539 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:10:52.054625 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:10:52.381938 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:10:52.994894 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:10:52.994981 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:10:52.995058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:10:52.995146 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:10:52.995215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:10:52.995288 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:10:52.995357 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:10:53.304680 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:10:55.747831 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:10:55.747941 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:10:55.748024 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:10:55.748104 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:10:55.748186 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:10:55.748268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:10:55.748347 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:10:56.057466 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:11:23.563884 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:11:23.564007 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:11:23.564094 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:11:23.564168 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:11:23.564249 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:11:23.564333 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:11:23.564418 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:11:23.878343 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:11:26.316195 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:11:26.316304 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:11:26.316381 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:11:26.316463 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:11:26.316542 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:11:26.316626 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:11:26.316709 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:11:26.618924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:11:52.180619 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:11:52.180709 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:11:52.181390 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:11:52.181946 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:11:52.182663 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:11:52.182941 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:11:52.183115 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:11:52.493939 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:11:54.142583 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:11:54.142696 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:11:54.142782 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:11:54.142848 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:11:54.142912 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:11:54.142977 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:11:54.143045 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:11:54.445302 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:11:56.880002 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:11:56.880114 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:11:56.880201 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:11:56.880285 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:11:56.880366 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:11:56.880439 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:11:56.880526 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:11:57.191385 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:12:24.708762 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:12:24.708857 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:12:24.708924 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:12:24.708995 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:12:24.709072 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:12:24.709141 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:12:24.709209 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:12:25.012845 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:12:27.456687 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:12:27.456784 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:12:27.456848 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:12:27.456910 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:12:27.456973 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:12:27.457036 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:12:27.457109 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:12:27.755007 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:12:52.307757 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:12:52.307851 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:12:52.307932 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:12:52.307998 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:12:52.308056 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:12:52.308125 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:12:52.308190 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:12:52.611454 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:12:55.279291 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:12:55.279383 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:12:55.279447 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:12:55.279521 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:12:55.279581 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:12:55.280676 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:12:55.281520 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:12:55.591391 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:12:58.019939 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:12:58.020026 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:12:58.020096 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:12:58.020160 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:12:58.020229 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:12:58.020300 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:12:58.020372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:12:58.325660 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:13:25.852736 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:13:25.852822 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:13:25.852891 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:13:25.852958 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:13:25.853024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:13:25.853091 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:13:25.853154 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:13:26.158956 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:13:28.585647 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:13:28.585741 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:13:28.585817 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:13:28.585892 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:13:28.585955 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:13:28.586018 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:13:28.586083 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:13:28.900456 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:13:52.438500 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:13:52.438582 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:13:52.438650 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:13:52.438714 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:13:52.438787 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:13:52.438857 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:13:52.438917 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:13:52.748987 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:13:56.423640 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:13:56.423733 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:13:56.423811 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:13:56.423874 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:13:56.423940 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:13:56.424001 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:13:56.424071 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:13:56.724472 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:13:59.168144 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:13:59.168255 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:13:59.168343 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:13:59.168421 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:13:59.168497 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:13:59.168577 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:13:59.168656 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:13:59.479434 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:14:26.980766 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:14:26.980859 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:14:26.980929 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:14:26.981004 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:14:26.981069 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:14:26.981140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:14:26.981200 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:14:27.286436 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:14:29.745148 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:14:29.745236 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:14:29.745302 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:14:29.745375 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:14:29.745447 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:14:29.745513 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:14:29.745578 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:14:30.057644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:14:52.567420 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:14:52.567518 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:14:52.567597 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:14:52.567678 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:14:52.567782 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:14:52.567861 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:14:52.567941 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:14:52.869209 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:14:57.549372 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:14:57.549497 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:14:57.549586 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:14:57.549683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:14:57.549769 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:14:57.549856 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:14:57.549926 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:14:57.850487 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:15:00.329804 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:15:00.329916 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:15:00.329995 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:15:00.330070 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:15:00.330137 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:15:00.330196 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:15:00.330267 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:15:00.649468 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:15:28.108114 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:15:28.108201 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:15:28.108279 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:15:28.108345 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:15:28.108421 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:15:28.108487 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:15:28.108559 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:15:28.415039 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:15:30.910368 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:15:30.910449 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:15:30.910525 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:15:30.910589 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:15:30.910657 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:15:30.910713 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:15:30.910786 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:15:31.215500 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:15:52.697714 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:15:52.698170 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:15:52.698434 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:15:52.699183 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:15:52.699317 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:15:52.699406 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:15:52.699487 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:15:53.010030 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:15:58.696442 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:15:58.696545 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:15:58.696616 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:15:58.696691 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:15:58.696768 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:15:58.696841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:15:58.696910 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:15:59.012491 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:16:01.476756 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:16:01.476855 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:16:01.476934 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:16:01.477002 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:16:01.477062 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:16:01.477128 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:16:01.477189 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:16:01.780424 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:16:29.283795 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:16:29.283876 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:16:29.283943 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:16:29.284010 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:16:29.284081 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:16:29.284143 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:16:29.284209 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:16:29.593932 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:16:32.038248 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:16:32.038329 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:16:32.038398 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:16:32.038467 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:16:32.038537 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:16:32.038598 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:16:32.038669 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:16:32.353127 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:16:52.824121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:16:52.824203 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:16:52.824270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:16:52.824335 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:16:52.824399 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:16:52.824464 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:16:52.824533 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:16:53.127953 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:16:59.858363 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:16:59.858474 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:16:59.858545 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:16:59.859145 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:16:59.860309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:16:59.860985 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:16:59.861703 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:17:00.181170 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:17:02.611547 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:17:02.611641 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:17:02.611711 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:17:02.611795 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:17:02.611868 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:17:02.611941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:17:02.612012 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:17:02.917561 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:17:30.444690 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:17:30.444808 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:17:30.444876 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:17:30.444937 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:17:30.445005 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:17:30.445065 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:17:30.445128 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:17:30.745422 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:17:33.178198 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:17:33.178292 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:17:33.178362 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:17:33.178421 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:17:33.178490 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:17:33.178547 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:17:33.178616 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:17:33.488369 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:17:52.950032 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:17:52.950112 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:17:52.950193 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:17:52.950247 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:17:52.950310 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:17:52.950370 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:17:52.950433 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:17:53.258296 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:18:01.008442 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:18:01.008557 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:18:01.008619 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:18:01.008689 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:18:01.008764 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:18:01.008829 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:18:01.008891 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:18:01.311618 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:18:03.748229 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:18:03.748316 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:18:03.748387 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:18:03.748455 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:18:03.748520 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:18:03.748576 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:18:03.748634 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:18:04.057292 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:18:31.574941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:18:31.575045 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:18:31.575128 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:18:31.575215 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:18:31.575296 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:18:31.575376 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:18:31.575476 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:18:31.888327 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:18:34.320951 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:18:34.321034 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:18:34.321108 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:18:34.321178 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:18:34.321254 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:18:34.321325 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:18:34.321393 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:18:34.625152 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:18:53.079588 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:18:53.079661 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:18:53.079731 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:18:53.079803 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:18:53.079870 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:18:53.079935 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:18:53.080003 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:18:53.393756 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:19:02.163562 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:19:02.163652 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:19:02.163739 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:19:02.163822 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:19:02.163884 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:19:02.163947 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:19:02.164006 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:19:02.485019 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:19:04.886018 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:19:04.886103 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:19:04.886169 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:19:04.886233 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:19:04.886296 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:19:04.886372 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:19:04.886433 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:19:05.195078 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:19:14.234630 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:19:14.234740 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:19:14.234809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:19:14.234877 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:19:14.234939 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:19:14.235005 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:19:14.235063 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:19:14.546917 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:19:32.752728 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:19:32.752812 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:19:32.752881 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:19:32.752951 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:19:32.753019 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:19:32.753086 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:19:32.753152 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:19:33.083848 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:19:35.452783 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:19:35.452867 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:19:35.452929 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:19:35.452994 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:19:35.453061 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:19:35.453118 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:19:35.453194 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:19:35.758256 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:19:53.204739 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:19:53.204858 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:19:53.204943 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:19:53.205019 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:19:53.205117 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:19:53.205195 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:19:53.205275 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:19:53.512909 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:20:03.352001 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:20:03.352129 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:20:03.352210 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:20:03.352301 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:20:03.352380 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:20:03.352467 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:20:03.352540 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:20:03.656513 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:20:06.019102 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:20:06.019221 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:20:06.019300 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:20:06.019375 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:20:06.019446 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:20:06.019517 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:20:06.019590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:20:06.335460 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:20:33.920836 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:20:33.920937 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:20:33.921032 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:20:33.921116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:20:33.921195 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:20:33.921270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:20:33.921356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:20:34.235081 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:20:36.597882 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:20:36.597992 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:20:36.598066 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:20:36.598136 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:20:36.598210 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:20:36.598284 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:20:36.598352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:20:36.898099 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:20:53.331113 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:20:53.331191 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:20:53.331254 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:20:53.331323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:20:53.331387 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:20:53.331450 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:20:53.331517 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:20:53.640013 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:21:04.497756 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:21:04.497848 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:21:04.497921 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:21:04.497992 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:21:04.498058 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:21:04.498122 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:21:04.498188 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:21:04.803624 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:21:07.161055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:21:07.161169 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:21:07.161255 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:21:07.161342 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:21:07.161418 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:21:07.161506 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:21:07.161586 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:21:07.463644 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:21:35.074397 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:21:35.074523 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:21:35.074592 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:21:35.074665 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:21:35.074746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:21:35.074819 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:21:35.074885 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:21:35.387213 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:21:37.731398 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:21:37.731497 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:21:37.731593 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:21:37.731662 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:21:37.731756 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:21:37.731822 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:21:37.731894 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:21:38.035242 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:21:53.456452 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:21:53.456529 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:21:53.456597 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:21:53.456663 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:21:53.456738 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:21:53.456806 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:21:53.456871 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:21:53.763393 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:22:05.643820 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:22:05.643921 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:22:05.644007 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:22:05.644092 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:22:05.644177 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:22:05.644252 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:22:05.644339 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:22:05.951158 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:22:08.304966 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:22:08.305068 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:22:08.305136 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:22:08.305211 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:22:08.305291 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:22:08.305360 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:22:08.305439 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:22:08.614967 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:22:36.213788 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:22:36.213880 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:22:36.213950 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:22:36.214020 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:22:36.214086 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:22:36.214154 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:22:36.214223 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:22:36.525857 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:22:38.874294 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:22:38.874376 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:22:38.874447 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:22:38.874511 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:22:38.874573 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:22:38.874637 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:22:38.874706 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:22:39.174224 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:22:53.584144 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:22:53.584261 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:22:53.584343 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:22:53.584420 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:22:53.584500 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:22:53.584576 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:22:53.584655 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:22:53.888702 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:23:06.783281 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:23:06.783373 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:23:06.783449 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:23:06.783522 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:23:06.783594 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:23:06.783654 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:23:06.783731 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:23:07.087853 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:23:09.444051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:23:09.444177 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:23:09.444257 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:23:09.444343 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:23:09.444421 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:23:09.444489 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:23:09.444564 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:23:09.745722 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:23:37.352217 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:23:37.352308 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:23:37.352380 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:23:37.352444 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:23:37.352522 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:23:37.352590 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:23:37.352666 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:23:37.656157 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:23:40.010966 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:23:40.011060 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:23:40.011122 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:23:40.011183 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:23:40.011263 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:23:40.011319 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:23:40.011378 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:23:40.325910 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:23:53.715171 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:23:53.715261 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:23:53.715345 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:23:53.715430 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:23:53.715508 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:23:53.715584 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:23:53.715659 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:23:54.026301 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:24:07.921039 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:24:07.921139 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:24:07.921216 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:24:07.921292 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:24:07.921363 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:24:07.921435 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:24:07.921508 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:24:08.227626 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:24:10.583423 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:24:10.583504 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:24:10.583584 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:24:10.583651 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:24:10.583712 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:24:10.583783 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:24:10.583847 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:24:10.893872 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:24:38.484161 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:24:38.484242 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:24:38.484308 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:24:38.484378 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:24:38.484444 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:24:38.484505 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:24:38.484565 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:24:38.794846 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:24:41.153094 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:24:41.153182 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:24:41.153258 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:24:41.153332 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:24:41.153389 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:24:41.153449 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:24:41.153506 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:24:41.459674 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:24:53.842911 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:24:53.842992 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:24:53.843070 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:24:53.843155 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:24:53.843220 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:24:53.843287 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:24:53.843356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:24:54.151524 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:25:09.058879 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:25:09.059000 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:25:09.059087 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:25:09.059170 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:25:09.059258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:25:09.059339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:25:09.059419 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:25:09.370136 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:25:11.719356 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:25:11.719455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:25:11.719535 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:25:11.719608 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:25:11.719687 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:25:11.719771 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:25:11.719843 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:25:12.035259 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:25:39.632474 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:25:39.632556 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:25:39.632626 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:25:39.632694 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:25:39.632771 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:25:39.632833 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:25:39.632892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:25:39.946962 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:25:42.301972 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:25:42.302068 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:25:42.302136 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:25:42.302201 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:25:42.302262 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:25:42.302328 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:25:42.302396 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:25:42.604139 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:25:53.969092 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:25:53.969198 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:25:53.969283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:25:53.969356 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:25:53.969436 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:25:53.969513 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:25:53.969596 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:25:54.285808 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:26:10.226969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:26:10.227055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:26:10.227133 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:26:10.227211 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:26:10.227282 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:26:10.227355 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:26:10.227422 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:26:10.535656 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:26:12.865791 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:26:12.865870 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:26:12.865949 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:26:12.866008 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:26:12.866079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:26:12.866142 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:26:12.866204 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:26:13.170497 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:26:40.792647 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:26:40.792734 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:26:40.792813 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:26:40.792880 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:26:40.792949 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:26:40.793020 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:26:40.793079 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:26:41.104582 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:26:43.435028 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:26:43.435120 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:26:43.435180 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:26:43.435247 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:26:43.435307 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:26:43.435375 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:26:43.435438 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:26:43.741901 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:26:54.096575 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:26:54.096665 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:26:54.096744 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:26:54.096810 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:26:54.096882 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:26:54.096952 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:26:54.097011 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:26:54.410760 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:27:11.371270 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:27:11.371403 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:27:11.371466 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:27:11.371532 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:27:11.371588 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:27:11.371645 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:27:11.371702 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:27:11.680260 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:27:14.006344 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:27:14.006427 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:27:14.006495 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:27:14.006557 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:27:14.006624 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:27:14.006690 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:27:14.006762 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:27:14.313849 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:27:41.948475 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:27:41.948561 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:27:41.948633 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:27:41.948699 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:27:41.948771 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:27:41.948842 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:27:41.948912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:27:42.263153 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:27:44.573253 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:27:44.573354 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:27:44.573431 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:27:44.573495 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:27:44.573553 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:27:44.573632 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:27:44.573697 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:27:44.879766 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:27:54.225940 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:27:54.226019 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:27:54.226083 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:27:54.226151 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:27:54.226212 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:27:54.226286 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:27:54.226344 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:27:54.539527 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:28:12.526562 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:28:12.526652 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:28:12.526732 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:28:12.526805 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:28:12.526865 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:28:12.526933 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:28:12.526994 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:28:12.833765 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:28:15.139198 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:28:15.139904 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:28:15.140007 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:28:15.140079 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:28:15.140203 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:28:15.140277 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:28:15.140353 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:28:15.446945 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:28:43.093413 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:28:43.093507 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:28:43.093575 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:28:43.093645 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:28:43.093712 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:28:43.093789 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:28:43.093859 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:28:43.399457 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:28:45.712573 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:28:45.712652 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:28:45.712726 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:28:45.712792 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:28:45.712861 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:28:45.712928 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:28:45.713004 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:28:46.012060 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:28:54.352035 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:28:54.352120 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:28:54.352193 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:28:54.352275 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:28:54.352337 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:28:54.352408 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:28:54.352473 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:28:54.662483 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:29:13.657514 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:29:13.657607 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:29:13.657682 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:29:13.657754 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:29:13.657820 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:29:13.657886 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:29:13.657941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:29:13.970971 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:29:16.280298 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:29:16.280381 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:29:16.280454 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:29:16.280515 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:29:16.280580 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:29:16.280642 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:29:16.280705 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:29:16.587475 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:29:44.257485 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:29:44.257608 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:29:44.257695 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:29:44.257797 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:29:44.258442 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:29:44.259010 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:29:44.259348 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:29:44.566161 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:29:46.848756 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:29:46.848878 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:29:46.848958 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:29:46.849040 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:29:46.849130 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:29:46.849204 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:29:46.849282 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:29:47.157978 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:29:54.472668 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:29:54.472794 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:29:54.472874 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:29:54.472953 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:29:54.473041 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:29:54.473126 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:29:54.473211 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:29:54.780889 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:30:14.855689 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:30:14.855824 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:30:14.855889 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:30:14.855965 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:30:14.856042 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:30:14.856116 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:30:14.856179 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:30:15.163512 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:30:17.423949 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:30:17.424080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:30:17.424151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:30:17.424228 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:30:17.424296 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:30:17.424371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:30:17.424436 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:30:17.742760 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:30:45.430810 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:30:45.430902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:30:45.430963 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:30:45.431027 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:30:45.431090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:30:45.431153 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:30:45.431212 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:30:45.735622 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:30:48.008710 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:30:48.009007 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:30:48.009582 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:30:48.009686 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:30:48.009809 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:30:48.009927 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:30:48.010027 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:30:48.321816 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:30:54.591937 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:30:54.592033 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:30:54.592104 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:30:54.592172 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:30:54.592240 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:30:54.592307 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:30:54.592374 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:30:54.897873 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:31:15.992944 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:31:15.993062 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:31:15.993128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:31:15.993196 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:31:15.993261 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:31:15.993332 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:31:15.993394 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:31:16.295653 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:31:18.582066 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:31:18.582171 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:31:18.582233 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:31:18.582294 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:31:18.582351 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:31:18.582415 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:31:18.582472 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:31:18.881204 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:31:46.554653 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:31:46.554753 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:31:46.554850 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:31:46.554939 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:31:46.555026 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:31:46.555111 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:31:46.555183 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:31:46.858332 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:31:49.140979 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:31:49.141101 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:31:49.141191 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:31:49.141268 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:31:49.141341 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:31:49.141428 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:31:49.141497 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:31:49.454808 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:31:54.715812 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:31:54.715901 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:31:54.715976 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:31:54.716051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:31:54.716124 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:31:54.716201 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:31:54.716267 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:31:55.029712 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:32:17.120565 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:32:17.120667 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:32:17.120738 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:32:17.120802 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:32:17.120873 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:32:17.120943 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:32:17.121021 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:32:17.424510 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:32:19.714637 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:32:19.714750 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:32:19.714816 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:32:19.714880 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:32:19.714960 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:32:19.715025 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:32:19.715092 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:32:20.027329 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:32:47.682981 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:32:47.683084 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:32:47.683157 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:32:47.683230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:32:47.683296 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:32:47.683355 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:32:47.683436 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:32:48.000237 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:32:50.299614 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:32:50.299723 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:32:50.299831 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:32:50.299909 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:32:50.299999 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:32:50.300090 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:32:50.300181 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:32:50.598066 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:32:54.836580 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:32:54.836670 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:32:54.836763 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:32:54.836855 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:32:54.836941 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:32:54.837022 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:32:54.837121 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:32:55.157466 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:33:18.265343 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:33:18.265439 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:33:18.265529 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:33:18.265610 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:33:18.265691 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:33:18.265783 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:33:18.265860 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:33:18.571052 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:33:20.854818 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:33:20.854908 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:33:20.854985 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:33:20.855061 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:33:20.855134 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:33:20.855210 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:33:20.855283 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:33:21.161271 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:33:48.827834 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:33:48.827925 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:33:48.827991 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:33:48.828054 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:33:48.828119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:33:48.828178 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:33:48.828233 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:33:49.131697 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:33:51.421463 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:33:51.421549 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:33:51.421617 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:33:51.421679 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:33:51.421754 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:33:51.421818 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:33:51.421894 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:33:51.724840 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:33:54.957040 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:33:54.957119 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:33:54.957194 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:33:54.957253 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:33:54.957320 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:33:54.957384 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:33:54.957457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:33:55.281111 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:34:19.410971 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:34:19.411051 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:34:19.411113 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:34:19.411172 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:34:19.411233 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:34:19.411289 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:34:19.411348 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:34:19.714062 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:34:22.000270 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:34:22.000366 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:34:22.000433 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:34:22.000495 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:34:22.000554 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:34:22.000613 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:34:22.000682 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:34:22.326057 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:34:49.980122 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:34:49.980209 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:34:49.980285 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:34:49.980349 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:34:49.980414 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:34:49.980480 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:34:49.980539 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:34:50.305456 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:34:52.587478 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:34:52.587562 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:34:52.587628 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:34:52.587694 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:34:52.587765 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:34:52.587830 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:34:52.587892 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:34:52.898655 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:34:55.080879 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:34:55.080967 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:34:55.081033 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:34:55.081092 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:34:55.081148 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:34:55.081217 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:34:55.081277 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:34:55.405084 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:35:20.569498 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:35:20.569588 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:35:20.569657 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:35:20.569726 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:35:20.569804 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:35:20.569877 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:35:20.571039 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:35:20.879052 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:35:23.156480 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:35:23.156576 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:35:23.156641 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:35:23.156712 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:35:23.156781 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:35:23.156846 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:35:23.156905 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:35:23.462437 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:35:51.144576 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:35:51.144686 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:35:51.144772 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:35:51.144856 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:35:51.144933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:35:51.145016 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:35:51.145107 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:35:51.445803 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:35:53.722256 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:35:53.722369 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:35:53.722444 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:35:53.722526 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:35:53.722614 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:35:53.722698 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:35:53.722782 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:35:54.033472 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:35:55.203429 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:35:55.203519 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:35:55.203607 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:35:55.203687 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:35:55.203778 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:35:55.203859 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:35:55.203941 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:35:55.512855 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:36:21.704145 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:36:21.704276 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:36:21.704352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:36:21.704432 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:36:21.704524 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:36:21.704611 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:36:21.704706 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:36:22.020548 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:36:24.304414 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:36:24.305056 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:36:24.305143 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:36:24.305264 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:36:24.305355 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:36:24.305438 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:36:24.305521 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:36:24.611230 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:36:52.306909 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:36:52.307040 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:36:52.307109 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:36:52.307183 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:36:52.307255 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:36:52.307331 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:36:52.307398 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:36:52.607872 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:36:54.873066 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:36:54.873163 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:36:54.873231 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:36:54.873293 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:36:54.873360 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:36:54.873426 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:36:54.873491 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:36:55.191129 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:36:55.456001 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:36:55.456078 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:36:55.456143 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:36:55.456209 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:36:55.456267 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:36:55.456347 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:36:55.456416 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:36:55.760797 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:37:22.865356 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:37:22.865436 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:37:22.865505 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:37:22.865565 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:37:22.865625 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:37:22.865690 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:37:22.865759 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:37:23.170508 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:37:25.456948 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:37:25.457034 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:37:25.457102 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:37:25.457164 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:37:25.457231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:37:25.457293 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:37:25.457364 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:37:25.766586 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:37:53.438676 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:37:53.438782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:37:53.438859 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:37:53.438936 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:37:53.439002 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:37:53.439070 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:37:53.439136 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:37:53.748432 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:37:55.443696 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:37:55.443818 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:37:55.443882 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:37:55.443948 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:37:55.444016 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:37:55.444082 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:37:55.444150 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:37:55.754972 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:37:56.029124 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:37:56.029204 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:37:56.029268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:37:56.029332 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:37:56.029398 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:37:56.029460 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:37:56.029523 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:37:56.335125 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:38:24.007820 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:38:24.007910 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:38:24.007976 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:38:24.008044 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:38:24.008106 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:38:24.008173 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:38:24.008236 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:38:24.320024 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:38:26.602957 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:38:26.603055 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:38:26.603127 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:38:26.603198 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:38:26.603274 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:38:26.603345 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:38:26.603410 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:38:26.907789 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:38:54.581113 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:38:54.581198 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:38:54.581263 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:38:54.581330 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:38:54.581390 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:38:54.581453 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:38:54.581517 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:38:54.888443 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:38:55.573377 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:38:55.573465 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:38:55.573539 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:38:55.573607 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:38:55.573691 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:38:55.573769 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:38:55.573838 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:38:55.874890 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:38:57.173827 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:38:57.173927 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:38:57.174009 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:38:57.174080 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:38:57.174149 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:38:57.174218 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:38:57.174284 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:38:57.477625 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:39:25.155210 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:39:25.155293 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:39:25.155371 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:39:25.155436 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:39:25.155503 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:39:25.155565 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:39:25.155633 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:39:25.465998 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:39:27.740005 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:39:27.740085 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:39:27.740150 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:39:27.740212 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:39:27.740272 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:39:27.740348 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:39:27.740405 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:39:28.041691 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:39:55.692057 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:39:55.692140 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:39:55.692203 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:39:55.692274 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:39:55.692336 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:39:55.692400 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:39:55.692461 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:39:55.996500 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:39:56.254013 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:39:56.254122 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:39:56.254186 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:39:56.254255 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:39:56.254336 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:39:56.254400 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:39:56.254467 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:39:56.560529 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:39:58.301036 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:39:58.301126 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:39:58.301197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:39:58.301264 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:39:58.301323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:39:58.301391 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:39:58.301449 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:39:58.615910 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:40:26.256816 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:40:26.256917 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:40:26.256980 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:40:26.257042 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:40:26.257108 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:40:26.257172 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:40:26.257242 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:40:26.559848 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:40:28.879319 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:40:28.879402 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:40:28.879471 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:40:28.879535 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:40:28.879595 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:40:28.879659 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:40:28.879725 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:40:29.187037 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:40:55.811809 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:40:55.811898 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:40:55.811967 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:40:55.812047 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:40:55.812107 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:40:55.812172 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:40:55.812230 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:40:56.120207 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:40:56.818163 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:40:56.818257 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:40:56.818323 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:40:56.818387 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:40:56.818453 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:40:56.818513 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:40:56.818577 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:40:57.121731 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:40:59.451590 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:40:59.451677 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:40:59.451747 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:40:59.452999 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:40:59.453643 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:40:59.454122 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:40:59.454596 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:40:59.759578 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:41:27.382027 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:41:27.382118 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:41:27.382184 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:41:27.382253 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:41:27.382322 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:41:27.382389 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:41:27.382457 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:41:27.685442 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:41:30.022795 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:41:30.022892 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:41:30.022979 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:41:30.023063 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:41:30.023143 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:41:30.023229 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:41:30.023310 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:41:30.331346 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:41:55.932932 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:41:55.933035 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:41:55.933111 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:41:55.933184 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:41:55.933248 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:41:55.933312 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:41:55.933381 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:41:56.232769 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:41:57.950629 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:41:57.950740 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:41:57.950819 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:41:57.950888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:41:57.950956 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:41:57.951018 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:41:57.951076 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:41:58.267523 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:42:00.588362 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:42:00.588465 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:42:00.588538 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:42:00.588618 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:42:00.588700 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:42:00.588806 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:42:00.588903 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:42:00.884538 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:42:28.532730 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:42:28.532849 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:42:28.532918 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:42:28.533000 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:42:28.533069 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:42:28.533138 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:42:28.533209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:42:28.845165 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:42:31.149824 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:42:31.149936 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:42:31.150005 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:42:31.150074 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:42:31.150139 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:42:31.150202 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:42:31.150277 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:42:31.454893 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:42:56.058841 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:42:56.058960 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:42:56.059049 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:42:56.059125 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:42:56.059206 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:42:56.059280 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:42:56.059362 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:42:56.362653 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:42:59.115770 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:42:59.115881 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:42:59.115961 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:42:59.116034 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:42:59.116124 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:42:59.116196 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:42:59.116269 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:42:59.440873 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:43:01.714981 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:43:01.715083 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:43:01.715142 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:43:01.715205 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:43:01.715292 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:43:01.715360 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:43:01.715422 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:43:02.042861 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:43:29.706323 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:43:29.706443 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:43:29.706520 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:43:29.706585 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:43:29.706651 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:43:29.706722 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:43:29.706784 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:43:30.016760 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:43:32.330794 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:43:32.330898 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:43:32.330977 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:43:32.331050 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:43:32.331125 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:43:32.331192 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:43:32.331269 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:43:32.635432 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:43:56.177512 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:43:56.177609 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:43:56.177677 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:43:56.177750 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:43:56.177817 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:43:56.177886 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:43:56.177956 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:43:56.485364 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:44:00.290475 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:44:00.290580 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:44:00.290649 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:44:00.290716 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:44:00.290788 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:44:00.290853 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:44:00.290926 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:44:00.599218 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:44:02.893969 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:44:02.894058 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:44:02.894128 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:44:02.894198 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:44:02.894269 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:44:02.894332 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:44:02.894397 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:44:03.198783 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:44:27.194942 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:44:27.195044 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:44:27.195116 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:44:27.195189 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:44:27.195250 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:44:27.195319 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:44:27.195378 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:44:27.498542 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:44:30.862079 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:44:30.862236 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:44:30.862318 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:44:30.862431 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:44:30.862519 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:44:30.862606 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:44:30.862698 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:44:31.164416 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:44:33.457936 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:44:33.458049 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:44:33.458135 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:44:33.458216 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:44:33.458290 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:44:33.458373 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:44:33.458447 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:44:33.762793 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:44:56.298323 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:44:56.298408 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:44:56.298486 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:44:56.298560 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:44:56.298631 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:44:56.298697 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:44:56.298781 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:44:56.601617 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:45:01.422920 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:45:01.423007 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:45:01.423073 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:45:01.423137 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:45:01.423202 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:45:01.423264 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:45:01.423333 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:45:01.732241 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:45:04.024896 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:45:04.024986 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:45:04.025074 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:45:04.025139 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:45:04.025200 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:45:04.025256 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:45:04.025320 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:45:04.327570 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:45:32.004226 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:45:32.004323 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:45:32.004386 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:45:32.004456 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:45:32.004525 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:45:32.004591 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:45:32.004656 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:45:32.318393 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:45:34.587739 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:45:34.587873 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:45:34.587945 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:45:34.588694 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:45:34.589632 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:45:34.590160 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:45:34.590482 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:45:34.903575 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:45:56.418870 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:45:56.418970 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:45:56.419055 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:45:56.419130 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:45:56.419214 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:45:56.419292 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:45:56.419365 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:45:56.720422 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:46:02.582951 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:46:02.583066 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:46:02.583149 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:46:02.583230 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:46:02.583307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:46:02.583391 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:46:02.583472 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:46:02.886161 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:46:05.163398 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:46:05.163509 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:46:05.163590 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:46:05.163658 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:46:05.163746 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:46:05.163825 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:46:05.163902 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:46:05.474955 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:46:33.145775 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:46:33.145867 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:46:33.145933 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:46:33.146001 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:46:33.146071 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:46:33.146135 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:46:33.146203 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:46:33.454572 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:46:35.739801 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:46:35.739906 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:46:35.739984 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:46:35.740064 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:46:35.740155 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:46:35.740237 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:46:35.740313 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:46:36.046395 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:46:56.542355 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:46:56.542434 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:46:56.542516 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:46:56.542582 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:46:56.542648 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:46:56.542727 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:46:56.542802 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:46:56.850931 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:47:03.714627 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:47:03.714707 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:47:03.714781 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:47:03.714848 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:47:03.714916 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:47:03.714984 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:47:03.715044 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:47:04.016410 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:47:06.301100 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:47:06.301188 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:47:06.301268 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:47:06.301335 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:47:06.301398 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:47:06.301464 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:47:06.301520 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:47:06.606832 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:47:34.283407 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:47:34.283519 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:47:34.283581 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:47:34.283646 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:47:34.283711 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:47:34.283775 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:47:34.283841 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:47:34.588782 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:47:36.867496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:47:36.867600 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:47:36.867663 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:47:36.867735 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:47:36.867799 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:47:36.867860 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:47:36.867919 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:47:37.169107 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:47:56.661180 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:47:56.661255 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:47:56.661319 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:47:56.661384 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:47:56.661447 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:47:56.661510 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:47:56.661576 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:47:56.968895 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:48:04.852723 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:48:04.852812 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:48:04.852886 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:48:04.852946 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:48:04.853014 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:48:04.853078 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:48:04.853140 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:48:05.157342 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:48:07.428786 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:48:07.428869 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:48:07.428937 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:48:07.428999 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:48:07.429059 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:48:07.429117 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:48:07.429182 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:48:07.734877 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:48:35.421332 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:48:35.421411 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:48:35.421484 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:48:35.421546 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:48:35.421610 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:48:35.421688 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:48:35.421768 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:48:35.728998 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:48:37.989414 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:48:37.989495 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:48:37.989571 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:48:37.989641 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:48:37.989701 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:48:37.989775 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:48:37.989833 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:48:38.300087 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:48:56.780783 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:48:56.780861 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:48:56.780924 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:48:56.780991 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:48:56.781058 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:48:56.781123 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:48:56.781189 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:48:57.087881 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:49:05.985589 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:49:05.985683 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:49:05.985762 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:49:05.985828 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:49:05.985887 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:49:05.985952 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:49:05.986014 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:49:06.285885 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:49:08.561650 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:49:08.561753 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:49:08.561856 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:49:08.561930 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:49:08.562008 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:49:08.562084 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:49:08.562166 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:49:08.866886 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:49:36.545240 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:49:36.545340 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:49:36.545424 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:49:36.545502 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:49:36.545597 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:49:36.545673 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:49:36.545767 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:49:36.850944 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:49:39.128239 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:49:39.128342 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:49:39.128430 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:49:39.128512 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:49:39.128598 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:49:39.128679 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:49:39.128786 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:49:39.444793 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:49:56.902897 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:49:56.902983 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:49:56.903072 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:49:56.903133 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:49:56.903202 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:49:56.903264 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:49:56.903327 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:49:57.208106 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:50:07.116663 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:50:07.116784 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:50:07.116881 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:50:07.116967 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:50:07.117049 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:50:07.117127 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:50:07.117212 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:50:07.423618 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:50:09.709942 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:50:09.710055 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:50:09.710182 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:50:09.710276 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:50:09.710372 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:50:09.710482 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:50:09.710565 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:50:10.013928 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:50:37.685129 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:50:37.685218 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:50:37.685295 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:50:37.685378 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:50:37.685460 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:50:37.685537 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:50:37.685616 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:50:37.989583 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:50:40.283803 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:50:40.283903 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:50:40.283982 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:50:40.284056 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:50:40.284132 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:50:40.284202 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:50:40.284268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:50:40.590941 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:50:57.028892 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:50:57.029000 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:50:57.029079 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:50:57.029164 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:50:57.029241 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:50:57.029319 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:50:57.029409 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:50:57.331916 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:51:08.243826 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:51:08.243921 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:51:08.243999 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:51:08.244084 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:51:08.244146 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:51:08.244213 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:51:08.244283 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:51:08.557285 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:51:10.855932 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:51:10.856032 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:51:10.856096 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:51:10.856159 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:51:10.856235 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:51:10.856290 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:51:10.856350 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:51:11.158984 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:51:38.815305 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:51:38.815394 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:51:38.815469 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:51:38.815548 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:51:38.815616 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:51:38.815694 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:51:38.815788 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:51:39.119938 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:51:41.436237 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:51:41.436331 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:51:41.436396 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:51:41.436458 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:51:41.436531 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:51:41.436596 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:51:41.436658 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:51:41.741196 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:51:57.146888 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:51:57.146987 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:51:57.147059 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:51:57.147122 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:51:57.147182 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:51:57.147244 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:51:57.147302 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:51:57.461296 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:52:09.392444 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:52:09.392561 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:52:09.392643 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:52:09.392708 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:52:09.392780 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:52:09.392851 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:52:09.392916 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:52:09.692776 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:52:12.015102 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:52:12.015193 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:52:12.015255 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:52:12.015321 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:52:12.015386 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:52:12.015448 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:52:12.015521 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:52:12.334392 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:52:39.954455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:52:39.954538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:52:39.955465 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:52:39.955657 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:52:39.955878 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:52:39.956301 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:52:39.956768 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:52:40.261849 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:52:42.599817 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:52:42.599944 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:52:42.600035 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:52:42.600121 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:52:42.600213 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:52:42.600294 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:52:42.600385 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:52:42.907674 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:52:57.266964 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:52:57.267071 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:52:57.267140 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:52:57.267214 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:52:57.267289 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:52:57.267358 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:52:57.267437 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:52:57.568937 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:53:10.525312 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:53:10.525412 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:53:10.525496 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:53:10.525580 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:53:10.525651 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:53:10.525738 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:53:10.525812 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:53:10.826645 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:53:13.173534 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:53:13.173651 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:53:13.173735 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:53:13.173814 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:53:13.173893 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:53:13.173984 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:53:13.174059 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:53:13.481924 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:53:41.096532 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:53:41.096627 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:53:41.096711 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:53:41.096794 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:53:41.096872 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:53:41.096948 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:53:41.097024 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:53:41.407754 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:53:43.742194 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:53:43.742327 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:53:43.742409 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:53:43.742510 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:53:43.742595 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:53:43.742686 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:53:43.742778 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:53:44.052330 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:53:57.390493 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:53:57.390577 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:53:57.390643 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:53:57.390723 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:53:57.390782 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:53:57.390846 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:53:57.390912 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:53:57.694690 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:54:11.675625 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:54:11.675707 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:54:11.675781 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:54:11.675857 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:54:11.675918 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:54:11.675978 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:54:11.676045 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:54:11.998689 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:54:14.314666 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:54:14.314776 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:54:14.314866 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:54:14.314941 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:54:14.315025 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:54:14.315094 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:54:14.315170 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:54:14.621366 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:54:42.280470 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:54:42.280590 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:54:42.280664 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:54:42.280745 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:54:42.280823 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:54:42.280891 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:54:42.280966 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:54:42.583882 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:54:44.876658 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:54:44.876777 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:54:44.876847 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:54:44.876912 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:54:44.876971 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:54:44.877040 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:54:44.877104 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:54:45.190326 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:54:57.510832 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:54:57.511443 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:54:57.511535 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:54:57.511623 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:54:57.511769 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:54:57.511842 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:54:57.511924 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:54:57.816042 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:55:12.846387 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:55:12.846479 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:55:12.846556 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:55:12.846625 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:55:12.846691 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:55:12.846767 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:55:12.846835 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:55:13.148866 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:55:15.455383 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:55:15.455478 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:55:15.455554 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:55:15.455634 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:55:15.455707 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:55:15.455812 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:55:15.455897 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:55:15.766525 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:55:43.413798 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:55:43.413905 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:55:43.413988 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:55:43.414067 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:55:43.414145 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:55:43.414213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:55:43.414292 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:55:43.714534 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:55:46.023670 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:55:46.023791 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:55:46.023879 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:55:46.023959 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:55:46.024045 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:55:46.024128 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:55:46.024209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:55:46.326637 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:55:57.626919 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:55:57.627009 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:55:57.627076 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:55:57.627140 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:55:57.627206 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:55:57.627273 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:55:57.627342 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:55:57.933950 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:56:13.978862 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:56:13.978964 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:56:13.979030 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:56:13.979093 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:56:13.979162 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:56:13.979228 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:56:13.979289 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:56:14.300393 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:56:16.585973 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:56:16.586081 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:56:16.586154 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:56:16.586241 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:56:16.586323 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:56:16.586421 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:56:16.586497 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:56:16.890680 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:56:44.563300 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:56:44.563391 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:56:44.563472 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:56:44.563535 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:56:44.563613 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:56:44.563686 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:56:44.563763 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:56:44.871659 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:56:47.147479 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:56:47.147570 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:56:47.147636 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:56:47.147711 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:56:47.147776 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:56:47.147840 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:56:47.147904 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:56:47.458579 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:56:57.744652 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:56:57.744734 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:56:57.744807 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:56:57.744877 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:56:57.744950 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:56:57.745018 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:56:57.745082 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:56:58.049283 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:57:15.134258 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:57:15.134368 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:57:15.134438 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:57:15.134501 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:57:15.134569 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:57:15.134632 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:57:15.134696 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:57:15.435295 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:57:17.723641 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:57:17.723728 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:57:17.723798 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:57:17.723864 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:57:17.723933 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:57:17.723997 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:57:17.724057 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:57:18.027259 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:57:45.693308 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:57:45.693414 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:57:45.693498 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:57:45.693570 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:57:45.693643 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:57:45.693733 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:57:45.693805 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:57:45.999627 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:57:48.300134 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:57:48.300226 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:57:48.300293 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:57:48.300358 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:57:48.300426 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:57:48.300490 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:57:48.300554 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:57:48.608077 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:57:57.866547 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:57:57.866658 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:57:57.866728 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:57:57.866809 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:57:57.866895 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:57:57.866957 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:57:57.867021 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:57:58.174495 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:58:16.256644 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:58:16.256739 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:58:16.256811 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:58:16.256879 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:58:16.256944 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:58:16.257012 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:58:16.257076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:58:16.557153 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:58:18.872728 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:58:18.872827 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:58:18.872921 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:58:18.873004 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:58:18.873084 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:58:18.873157 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:58:18.873225 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:58:19.176949 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:58:46.820392 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:58:46.820480 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:58:46.820561 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:58:46.820628 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:58:46.820702 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:58:46.820790 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:58:46.820857 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:58:47.128473 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:58:49.436345 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:58:49.436428 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:58:49.436510 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:58:49.436572 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:58:49.436640 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:58:49.436700 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:58:49.436766 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:58:49.740370 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:58:57.982934 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:58:57.983050 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:58:57.983132 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:58:57.983213 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:58:57.983294 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:58:57.983381 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:58:57.983466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:58:58.283751 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:59:17.398810 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:59:17.398901 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:59:17.398975 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:59:17.399046 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:59:17.399120 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:59:17.399185 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:59:17.399247 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:59:17.711017 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:59:20.006428 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:59:20.006510 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:59:20.006580 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:59:20.006653 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:59:20.006723 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:59:20.006787 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:59:20.006846 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:59:20.311426 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:59:47.991245 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:59:47.991335 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:59:47.991412 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:59:47.991489 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:59:47.991559 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:59:47.991625 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:59:47.991690 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:59:48.300156 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:59:50.576022 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:59:50.576115 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:59:50.576183 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:59:50.576248 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:59:50.576312 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:59:50.576375 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:59:50.576438 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:59:50.894578 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 17:59:58.106815 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 17:59:58.106910 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 17:59:58.106994 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 17:59:58.107069 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 17:59:58.107152 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 17:59:58.107227 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 17:59:58.107307 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 17:59:58.436238 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:00:18.567810 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:00:18.567915 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:00:18.567998 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:00:18.568093 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:00:18.568177 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:00:18.568248 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:00:18.568322 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:00:18.871902 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:00:21.157958 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:00:21.158053 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:00:21.158135 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:00:21.158206 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:00:21.158294 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:00:21.158361 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:00:21.158437 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:00:21.472958 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:00:49.133012 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:00:49.133754 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:00:49.134132 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:00:49.134659 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:00:49.135262 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:00:49.135361 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:00:49.135455 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:00:49.446471 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:00:51.736304 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:00:51.736414 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:00:51.736493 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:00:51.736569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:00:51.736638 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:00:51.736710 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:00:51.736779 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:00:52.046841 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:00:58.235921 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:00:58.236002 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:00:58.236066 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:00:58.236130 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:00:58.236197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:00:58.236261 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:00:58.236331 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:00:58.539084 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:01:19.713063 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:01:19.713148 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:01:19.713208 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:01:19.713272 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:01:19.713339 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:01:19.713408 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:01:19.713466 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:01:20.023787 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:01:22.328461 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:01:22.328553 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:01:22.328613 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:01:22.328684 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:01:22.328754 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:01:22.328820 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:01:22.328886 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:01:22.635184 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:01:50.284148 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:01:50.284258 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:01:50.284365 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:01:50.284449 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:01:50.284545 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:01:50.284629 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:01:50.284702 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:01:50.587541 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:01:52.897209 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:01:52.897349 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:01:52.897446 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:01:52.897531 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:01:52.897620 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:01:52.897744 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:01:52.897828 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:01:53.203753 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:01:58.358452 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:01:58.358564 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:01:58.358646 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:01:58.358738 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:01:58.358821 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:01:58.358904 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:01:58.359012 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:01:58.665702 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:02:20.846045 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:02:20.846140 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:02:20.846217 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:02:20.846292 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:02:20.846360 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:02:20.846433 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:02:20.846501 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:02:21.151124 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:02:23.464237 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:02:23.464321 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:02:23.464404 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:02:23.464468 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:02:23.464538 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:02:23.464603 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:02:23.464662 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:02:23.770901 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:02:51.418863 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:02:51.418954 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:02:51.419022 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:02:51.419092 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:02:51.419151 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:02:51.419221 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:02:51.419290 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:02:51.727325 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:02:54.033139 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:02:54.033246 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:02:54.033332 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:02:54.033417 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:02:54.033478 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:02:54.033569 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:02:54.033635 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:02:54.355399 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:02:58.484840 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:02:58.484941 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:02:58.485017 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:02:58.485082 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:02:58.485152 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:02:58.485225 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:02:58.485289 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:02:58.789451 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:03:21.999588 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:03:21.999694 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:03:21.999764 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:03:21.999834 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:03:21.999897 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:03:21.999965 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:03:22.000031 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:03:22.332252 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:03:24.625033 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:03:24.625129 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:03:24.625192 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:03:24.625258 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:03:24.625319 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:03:24.625383 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:03:24.625440 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:03:24.930526 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:03:52.590592 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:03:52.590694 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:03:52.590776 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:03:52.590850 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:03:52.590932 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:03:52.591003 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:03:52.591060 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:03:52.898067 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:03:55.203574 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:03:55.203688 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:03:55.203786 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:03:55.203855 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:03:55.203931 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:03:55.204004 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:03:55.204076 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:03:55.510286 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:03:58.605931 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:03:58.606039 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:03:58.606131 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:03:58.606210 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:03:58.606296 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:03:58.606372 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:03:58.606456 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:03:58.911821 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:04:23.157256 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:04:23.157361 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:04:23.157426 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:04:23.157494 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:04:23.157561 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:04:23.157625 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:04:23.157690 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:04:23.469693 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:04:25.770692 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:04:25.770780 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:04:25.770853 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:04:25.770916 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:04:25.770984 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:04:25.771051 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:04:25.771113 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:04:26.079695 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:04:53.733034 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:04:53.733122 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:04:53.733189 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:04:53.733271 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:04:53.733330 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:04:53.733394 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:04:53.733453 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:04:54.043325 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:04:56.341949 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:04:56.342047 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:04:56.342116 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:04:56.342181 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:04:56.342248 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:04:56.342311 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:04:56.342372 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:04:56.646441 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:04:58.727440 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:04:58.727519 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:04:58.727590 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:04:58.727657 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:04:58.727730 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:04:58.727793 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:04:58.727868 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:04:59.036273 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:05:24.318039 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:05:24.318149 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:05:24.318227 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:05:24.318309 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:05:24.318385 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:05:24.318451 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:05:24.318535 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:05:24.622120 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:05:26.901683 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:05:26.901790 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:05:26.901876 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:05:26.901955 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:05:26.902036 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:05:26.902117 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:05:26.902197 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:05:27.205050 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:05:54.879892 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:05:54.879982 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:05:54.880064 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:05:54.880136 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:05:54.880207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:05:54.880280 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:05:54.880350 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:05:55.198467 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:05:57.464212 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:05:57.464330 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:05:57.464406 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:05:57.464491 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:05:57.464585 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:05:57.464665 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:05:57.464746 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:05:57.770823 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:05:58.853182 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:05:58.853279 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:05:58.853371 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:05:58.853449 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:05:58.853530 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:05:58.853613 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:05:58.853691 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:05:59.158406 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:06:25.467173 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:06:25.467268 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:06:25.467352 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:06:25.467442 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:06:25.467529 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:06:25.467603 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:06:25.467663 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:06:25.771649 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:06:28.033006 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:06:28.033102 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:06:28.033166 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:06:28.033231 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:06:28.033294 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:06:28.033362 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:06:28.033428 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:06:28.343790 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:06:56.025919 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:06:56.026018 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:06:56.026084 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:06:56.026142 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:06:56.026207 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:06:56.026269 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:06:56.026334 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:06:56.332947 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:06:58.608306 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:06:58.608399 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:06:58.608477 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:06:58.608541 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:06:58.608603 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:06:58.608665 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:06:58.608739 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:06:58.915646 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:06:59.177863 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:06:59.177967 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:06:59.178035 I | clusterdisruption-controller: osd "rook-ceph-osd-15" is down but no node drain is detected >2022-11-24 18:06:59.178101 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:06:59.178167 I | clusterdisruption-controller: osd "rook-ceph-osd-13" is down but no node drain is detected >2022-11-24 18:06:59.178230 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:06:59.178294 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:06:59.484300 I | clusterdisruption-controller: osd is down in failure domain "rack1" and pgs are not active+clean. pg health: "cluster is not fully clean. PGs: [{StateName:active+undersized Count:383} {StateName:active+undersized+degraded Count:225} {StateName:active+clean Count:1}]" >2022-11-24 18:07:26.600878 I | clusterdisruption-controller: osd "rook-ceph-osd-11" is down but no node drain is detected >2022-11-24 18:07:26.600991 I | clusterdisruption-controller: osd "rook-ceph-osd-6" is down but no node drain is detected >2022-11-24 18:07:26.601060 I | clusterdisruption-controller: osd "rook-ceph-osd-8" is down but no node drain is detected >2022-11-24 18:07:26.601119 I | clusterdisruption-controller: osd "rook-ceph-osd-4" is down but no node drain is detected >2022-11-24 18:07:26.601186 I | clusterdisruption-controller: osd "rook-ceph-osd-19" is down but no node drain is detected >2022-11-24 18:07:26.601246 I | clusterdisruption-controller: osd "rook-ceph-osd-15"